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PREFACE 


This  Technical  Note  (TN)  describes  the  results  of  a  study  to  investigate 
the  comparative  cloud  forecast  skill  of  several  numerical  analysis/forecast 
systems  at  the  Air  Force  Global  Weather  Central  (AFGWC)  and  the  National 
Meteorological  Center  (NMC) .  The  study  includes  examination  of  analysis  and 
forecast  model  databases  valid  during  the  period  August  to  September  1979.  At 
times  during  the  course  of  the  study,  progress  was  interrupted  by  higher 
priority  projects,  but  the  study  eventually  was  completed  and  reported 
internally  within  Air  Weather  Service  (AWS)  during  April  1981.  The  results  of 
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1.  INTRODUCTION 


Beginning  with  the  January  1979  meeting  at  AFGWC  of  the  USAF  Scientific 
Advisory  Board  (SAB) ,  Ad  Hoc  Committee  on  Improved  Cloud  Forecasting,  HQ  AWS 
initiated  the  formulation  of  a  plan  for  future  improvements  in  the  automated 
cloud  forecast  support  that  AWS  provides  to  DOD  customers.  To  obtain  further 
input  and  guidance  for  this  planning  effort,  HQ  AWS  in  February  1979  directed 
AFGWC  to  undertake  a  Forecast  Fields  Comparison  Test  in  which  cloud  forecast 
fields  derived  from  several  proposed  numerical  cloud  models  would  be 
compared.  The  concern  underlying  this  proposed  test  was  whether  a  new 
advanced  prediction  model  at  AFGWC  would  yield  sufficiently  improved  sensible 
weather  forecasts,  in  particular  cloud  forecasts,  to  justify  the  increased 
computation  costs  of  an  advanced  model. 

This  report  presents  the  results  of  this  test.  It  uses  AFGWC ' s  current 
production  cloud  model,  known  as  5 LAYER,  as  the  basis  for  comparisons.  The 
5LAYER  model  produces  extratropical  hemispheric  forecasts  of  tropospheric 
temperature  and  moisture,  from  which  are  derived  forecasts  of  layer  and  total 
cloud  (among  other  derived  parameters  such  as  precipitation  and  icing) . 

SLAYER  is  best  described  as  a  quasi-Lagrangian  model,  because  the  forecast 
mechanism  in  the  model  is  the  application  of  three-dimensional  air  parcel 
trajectories.  These  trajectories,  reinitialized  at  each  time  step,  are 
computed  from  input  forecast  wind  velocity  components,  a  more  complete 
description  of  5LAYER  is  given  by  Friend  and  Mitchell  (1982) . 

Owing  to  the  trajectory  computations,  5 LAYER  is  not  a  stand-alone  forecast 
model.  In  addition  to  initial  temperature  and  moisture  fields,  SLAYER  also 
requires  forecast  wind  input  from  a  separate  wind  forecast  model,  which 
currently  at  AFGWC  is  the  AWS  6LDPE .  Clearly,  the  forecast  skill  of  SLAYER  is 
substantially  dependent  on  the  skill  of  the  input  forecast  winds,  especially 
for  lone-range  forecasts. 

Significantly  improved  counterparts  of  the  AWS  6LDPE  model  are  executed 
operationally  at  other  meteorological  forecast  centers.  One  such  counterpart 
is  the  NMC  7LHFM  model,  the  primary  hemispheric  forecast  model  at  NMC  from 
January  1978  to  August  1980,  a  period  which  includes  the  August  1979  to 
September  1979  period  of  this  study.  The  7LHFM  and  6LDPE  models  are  closely 
related,  hydrostatic,  primitive  equation  models.  The  6LDPB  model  represents 
the  AFGWC  adaption  of  the  PE  model  of  Shuman  and  Hovermale  <1968) ,  first 
implemented  at  NMC  in  1966.  The  7LHFM  is  the  advanced  version  of  the  6LDPE  as 
it  has  evolved  at  NMC  over  the  last  15  years.  The  key  differences  between  the 
6LDPB  and  the  7LHFM  are  summarized  below: 

(a)  Addition  of  explicit  equations  and  algorithms  to  model  synoptic  and 
convective  moisture,  precipitation,  and  latent  heating. 

(b)  Addition  of  a  seventh  active  layer  to  improve  stratospheric  forecasts. 

(c)  Improved  modeling  of  radiative  heating  such  as  addition  of  longwave 
cooling  above  clouds. 

(d)  Expansion  of  model  grid  domain  to  cover  the  entire  hemisphere. 
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!(e)  Reduction  of  horizontal  grid  spacing  from  whole-mesh  (381  km)  to 
half-mesh  (190.5  km). 

(f)  Use  of  a  special  form  of  the  governing  physical  equations  known  as 
the  vorticity-energy  form. 

Verification  statistics  over  the  operational  lifetime  of  the  7LHFM  model 
show  a  significant  reduction  in  the  RMSVE  of  the  7LHFM  forecast  winds  versus 
the  6LDPE  forecast  winds.  We  shall  provide  later  a  specific  example  of  this 
error  reduction  from  the  data  archived  for  this  study.  Presumably,  if  the 
7LHFM  model  replaced  the  6LDPE  model  as  the  source  of  5 LAYER  driving  motion 
fields,  an  improved  cloud  forecast  would  result.  One  objective  of  this  study 
is  to  test  this  hypothesis  and  quantify  any  changes  in  forecast  accuracy. 

Improved  numerical  forecasts,  however,  are  obtained  invariably  at 
increased  computational  cost,  a  cost  increase  is  certainly  incurred  in  the 
case  of  the  7LHFM  versus  the  6L0PE .  Therefore,  we  will  quantify  any  change  in 
5LAYBR  forecast  accuracy  in  this  study  in  order  to  provide  useable  input  into 
cost/benefit  ratio  determinations.  For  this  reason,  we  shall  perform  an 
objective  model  comparison  based  on  objective  grid-to-grid  verification 
statistics. 

The  increased  cost  of  an  advanced  moist  dynamic  model  such  as  the  7LHPM, 
could  be  partially  offset  at  AFGHC  by  eliminating  SLAYER  and  replacing  it  with 
cloud  forecasts  derived  directly  from  the  7LHFM  moisture  forecasts.  A  second 
objective  in  this  study  is  to  determine  if  7LHFM-derived  cloud  forecasts  are 
competitive  with  SLAYER.  The  single,  moist,  high-resolution,  hemispheric  or 
global,  dynamic  model  concept  was  recommended  for  AFGHC  in  the  final  report  of 
the  aforementioned  SAB.  This  concept  is  employed  at  virtually  all  other  major 
numerical  weather  centrals  (NMC,  FWOC,  ECMWP,  and  CMC)  in  the  western 
E  countries.  AFGHC  however,  unlike  the  other  centrals  cited  above,  has  a 

I  particularly  strong  requirement  for  providing  automated,  gridded,  global 

forecasts  of  layer  and  total  cloud  cover.  The  requirement  initiated  the 
separate  development  of  the  5 LAYER  trajectory  model  in  the  middle  1960's 
before  moist  PE  models  were  available.  Thus,  before  eliminating  5 LAYER  to 
partially  offset  the  increased  cost  of  executing  an  advanced  PE  model,  we  must 
demonstrate  whether  or  not  a  moist  PE  model  can  at  least  maintain  and 
hopefully  surpass  the  skill  of  5 LAYER,  particularly  during  the  first  24  hours. 

In  summary  then,  the  two  objectives  of  this  study  are  as  follows: 

(a)  Quantify  the  change  in  the  total  cloud  forecast  accuracy  of  the 
SLAYER  cloud  model  when  forecast  winds  from  the  AWS  6LDPE  model  are  replaced 
with  forecast  winds  from  the  NMC  7LHFM  model.  If  forecast  accuracy  improves, 
quantify  degradations  in  this  improvement  resulting  from  the  delayed 
availability  of  the  7LBFM  databases  relative  to  current  6LDPE  database 
timeliness. 

(b)  Compare  the  accuracy  of  the  respective  total  cloud  forecasts  derived 
from  the  forecast  moisture  fields  of  the  NMC  7LHPM  model  and  the  AFGHC  5 LAYER 
cloud  model.  If  the  7LHFM-derived  forecasts  show  superior  accuracy,  quantify 
degradations  in  this  improvement  resulting  from  the  delayed  availability  of 
the  7LH7M  databases  relative  to  current  6LDPE  database  timeliness. 
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2.  TEST  METHODOLOGY 


2.1  Test  Period 

The  test  period  began  at  00Z  on  11  August  1979  and  continued  for  28  days 
through  00Z  on  18  September  1979.  During  this  period,  various  7LHFM,  6LDPE, 
and  5 LAYER  eodel  initial  analyses  and  forecasts  of  vertical  notion,  horizontal 
wind  velocity,  temperature,  moisture,  and  cloud  amount  were  archived  and  later 
used  in  forecast  comparisons  and  verifications.  This  section  describes  the 
specific  databases  that  were  archived  and  compared  and  the  verification 
procedures  that  were  used  in  this  study.  The  results  are  then  presented  in 
Section  3.  Conclusions  are  given  in  Section  4. 


2.2  Forecast  and  Analysis  Data  Sets 


2.2.1  7LHFM  Production  Forecasts 


The  7LHFM  forecasts  projected  onto  the  NMC  whole-mesh  grid  were  archived 
from  the  00Z  database  on  the  first  day  and  every  second  day  thereafter  during 
the  test  period.  Data  collected  included  horizontal  wind  components  (u.  v) . 
vertical  motion  (omega) ,  temperature  (T) .  and  relative  humidity  (RH)  at  the 
standard  pressure  levels  from  850  mb  through  300  mb  (except  400  mb)  and 
extending  out  to  48  hours  at  3-hour  intervals.  The  resulting  14  sets  of  7LHFM 
forecast  data  were  sent  to  AFGNC  on  magnetic  tapes.  These  tapes  were 
translated  and  reformatted  to  the  database  formats  of  AFGNC.  For  example,  the 
€5X65  NMC  whole-mesh  hemispheric  grid  was  truncated  to  the  47X51  subset  grid 
that  bounds  the  octagon  domain  of  the  AWS  6LDPE  (Hoke  et  al. .  1979) .  In 
addition,  the  7LHFM  RH  and  T  databases  were  used  to  derive  corresponding 
dew-point  (Td)  and  dew-point  depression  (T~Td)  databases. 


Explicit  cloud  amount  forecasts  are  not  provided  in  the  7LHFM  forecast 
database.  Therefore,  to  accomplish  objective  (b)  we  derived  cloud  amount 
forecasts  from  the  7LHFM  (T-Td)  databases  cited  above.  To  do  this,  we  used 
the  (T-T^) /cloud  conversion  algorithms  currently  used  in  SLAYER.  He  thereby 
ensured  that  the  comparisons  of  7LHFM  and  5LAYER  cloud  forecasts  in  objective 
(b)  are  in  fact  comparisons  of  moisture  forecast  skill  rather  than 
comparisons  of  two  different  moisture/cloud  conversion  algorithms.  He  next 
describe  in  some  detail  the  algorithm  used  to  convert  7LHFM  (T-Td)  forecasts 
to  cloud  amount  forecasts. 


At  each  standard  pressure  level  used  in  5 LAYER  (i.e.,  at  850,  700,  500, 
and  300  mb) ,  we  interpolated  the  whole-mesh  7LHFM  (T-Td)  forecasts  to  the 
93x101  half-mesh  5 LAYER  octagon  grid.  He  then  converted  the  interpolated 
7LHFM  half-mesh  (T-Tj)  values  to  Condensation  Pressure  Spread  (CPS) .  CPS  is 
defined  as  the  amount  of  dry  adiabatic  vertical  uplift  in  mb  required  for  an 
air  parcel,  having  a  given  T  and  Td  at  pressure  P,  to  reach  its  LCL.  CPS  is 
the  active  moisture  variable  carried  by  the  5LAYER  trajectory  model.  On  a 
thermodynamic  chart,  CPS  is  easily  derived  graphically  from  given  values  of  P, 
T,  and  Tj.  Analytically,  however,  the  relation  between  CPS,  P,  T,  and  Td 
is  given  by  an  impractical,  transcendental  equation  that  must  be  solved 
iteratively  (Irvine,  1981) .  Alternatively,  at  AFGHC  we  use  the  approximate 
relation  given  by 
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(1)  CPS-  (T-T<j> 1-4.9  -0.93 (P/1000)-9.0 (P/1000)2) . 

This  relation  yields  CPS  values  that  are  within  13  percent  of  the  rigorous, 
iteratively  derived  values  over  typical  tropospheric  ranges  of  T,  T<j,  and  P 
(Irvine,  1981) .  // 

Hie  conversion  of  CPS  to  cloud  aaount  is  accomplished  using the  set  of 
empirical  curves  in  Figure  1.  The  curves  have  been  stratified  by  standard 
pressure  level  and  are  applied  globally.  The  fact  that  the  CPS  curves  yield 
som  cloud  for  nonzero  CPS  values  owes  to  the  nonhraomneous  nature  of  an 
atmospheric  layer  over  a  large  area,  in  which  soM^jr^ction  of  the  area  nay 
have  locally  achieved  saturation  (zero  CPS  and  tnus  cloud) ,  although  the  areal 
average  CPS  value  is  nonzero. 

Equation  (1)  together  with  the  curves  in  Figure  1  permit  one  to  derive 
cloud  amount  forecasts  at  discrete  pressure  levels  from  (T-T<j)  forecasts  at 
those  levels.  Finally,  a  determination  of  total  cloud  amount  from  the  cloud 
amounts  at  discrete  levels  is  derived.  Because  total  cloud  is  the  most 
reliably  observed  and  analyzed  cloud  parameter  (as  opposed  to  ceilings,  tops, 
layer  cloud  aa»unts,  or  cloud  type) ,  total  cloud  will  be  the  single  cloud 
paraattter  verified  in  this  study.  The  relation  used  in  SLATER  and  also  here 
with  the  7LHVM  data  to  obtain  the  sum,  S,  of  two  fractional  layer  cloud 
amounts,  Ci  and  C2  (where  0  C2  Ci  1)  at  discrete  levels  1  and  2, 
is  given  by 

(2)  S  -  Ci  +  C2  (1  -  Cx)F 

where  F  is  a  variable  "unstacking*  or  randomness  factor  in  the  range  of  0  F  1. 
It  can  be  shown  that  Ci  S  1.  The  factor  F  measures  the  extent  of  overlap 
or  superposition  among  cloud  layers  and  it  is  specified  to  decrease  with 
increasing  vertical  separation  between  levels  1  and  2.  Thus  P  is  modeled 
conceptually  after  the  vertical  cloud  stacking  examples  in  Figure  2.  The 
vertical  cloud  summation  eafcodied  in  equation  (2)  and  Figure  2  is  probably 
least  reliable  in  areas  dominated  by  deep  convection.  More  details  on  the 
successive  application  of  equation  (2)  through  several  levels  and  the  values 
of  F  used  operationally  to  derive  total  cloud  are  given  in  Friend  and  Mitchell 
(1982) .  It  suffices  here  to  state  that  this  same  vertical  cloud  summation 
algorithm  was  used  to  obtain  both  7LHFM  and  5 LAYER  total  cloud  forecasts  for 
objective  (b) .  The  7LHFM  total  cloud  forecasts  obtained  by  the  techniques 
described  in  this  section  will  be  denoted  henceforth  in  figures  and 
discussions  as  MP7  forecasts  (NMC  Production  7LHFM) . 

2.2.2  5LAYBR  Production  Forecasts 

To  understand  the  5 LAYER  cloud  forecasts  that  were  archived  for  this 
study,  we  must  first  briefly  review  the  AFGMC  cloud  forecast  production 
cycle.  A  5 LAYER  forecast  is  initialised  and  executed  from  each  3DNKPH 
objective  cloud  analysis.  The  3DNEPH  is  described  by  Fye  (1978) .  The 
basetime  (i.e.,  the  0-hour  start  time)  of  each  SLAYER  forecast  is  therefore 
given  by  the  basetime  of  the  corresponding  3 DNEPR  analysis.  Because  of  the 
emphasis  at  AFGMC  on  short-range  cloud  forecasts,  the  3 DNEPR/ 5 LAYER  cloud 
analysis  and  forecast  system  cycles  eight  times  daily  starting  at  00Z  plus 
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•vtty  three  hours.  Th«  main  obssrvstionsl  data  sat  input  to  tha  3DNEPH 
analysis  during  aacfa  cycle  is  infrarad  polar  orbiting  satallita  cloud  iaagary 
(from  either  ROM  or  DMSP  vehicles) .  in  contrast*  tha  B0FANL/6LDPE  wind 
analysis  and  forecast  system*  which  drives  5 LAYBX  trajectories*  cycles  every 
six  hours  starting  at  008*  or  only  four  tines  per  day.  The  crucial  point  here 
is  that  owing  to  current  production  3DMSPH  and  6L0PE  scheduled  coopletion 
tines  and  the  above  differences  in  cycle  frequency*  the  6LDPE  forecast  at 
baaetine  TT8  provides  the  driving  notion  fields  for  SLATER  forecasts  at 
baaetines  (TT  ♦  03) t  and  (TT  ♦  06)  X.  The  AFGNC  autonated  cloud  analysis  and 
forecast  cycling  is  described  in  nore  detail  by  Tarbell  and  Boke  (1979) . 

For  this  study*  the  northern  hanisphere  039*  099*  and  159  5 LAYER 
forecasts*  which  respectively  use  the  003*  063*  and  123  6 LOPE  wind  forecasts* 
were  archived  on  the  14  test  days  corresponding  to  the  14  archived  003  7LHPM 
forecasts.  These  production  SLATER  forecasts  will  be  denoted  henceforth  in 
figures  and  discussions  as  GPS  (APGMC  Production  SLATER). 

2.2.3  SLATER  Test  Forecasts 

The  MP7  cloud  forecasts  that  we  derived  as  described  in  Section  2.2.1  were 
needed  to  answer  objective  (b).  To  answer  objective  (a)*  the  033*  093*  and 
153  SLATER  aodel  runs  were  executed  again*  using  in  each  case  the  003  7LBPM 
wind  forecasts  as  input.  The  sane  production  033*  093*  and  153  3DNEPH  cloud 
analyses*  respectively*  were  used  to  derive  the  SLATER  initial  eoisture 
fields.  These  test  SLATER  forecasts  using  7LHPM  notion  fields  will  be  denoted 
henceforth  in  figures  and  discussions  as  GTS  (APGNC  Test  5LATER) .  The  098  and 
153  GTS  forecasts  were  United  to  a  maximum  36-hour  range  owing  to  the  003 
7LBPM  forecasts  having  been  archived  only  out  to  48  hours. 

2.3  Definition  of  Forecast  Cases 

The  chosen  combinations  of  production  and  test  forecasts  that  were  used  to 
evaluate  objectives  (a)  and  (b)  are  summarised  in  Table  1  and  described  in 
detail  below. 

2.3.1  Forecast  cases  for  objective  (a)  (Cases  A-C) 

Case  Ai  The  GP5  and  GTS  total  cloud  forecasts  labled  A  in  Table  1  were 
cospared  to  answer  the  first  part  of  objective  (a) *  wherein  we  assume  that  the 
7L8PM  and  6 LOPE  databases  for  basetime  TT3  are  available  concurrently.  These 
comparisons  measure  the  sensitivity  of  SLATER  to  the  accuracy  of  the  input 
motion  field  without  regard  to  the  timely  availability  of  the  motion  field  in 
a  given  production  cycle. 

Case  Bt  The  GPS  and  GT5  total  cloud  forecasts  labled  B  in  Table  1  were 
compared  to  answer  the  second  part  of  objective  (a) *  wherein  we  seek  to 
measure  the  impact  of  a  6-hour  later  offset  in  the  time  availability  of  the 
7LKPM  versus  the  6LDPB  wind  databases  in  a  given  production  cycle.  We  expect 
this  simulated  7LBPM  delay  to  reduce  somewhat*  any  increase  in  GTS  versus  GP5 
accuracy  from  the  previous  case. 

Case  Ct  Closely  analogous  to  case  B*  the  GP5  and  GTS  total  cloud 
forecasts  labeled  C  in  Table  1  also  were  compared  to  answer  the  second  part  of 
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objective  (a),  except ,  in  this  case,  we  measure  the  impact  of  a  12-hour  later 
offset  in  the  7LHVM  versus  6LDPB  database  time  of  availability  for  a  given 
production  cycle.  We  regard  this  case  as  a  worst  case  situation  in  which,  for 
example,  the  AFGMC  06*  and  18*  6LDPE  wind  forecast  cycles  are  eliminated  in 
conjunction  with  the  implementation  of  an  advanced  model  having  a  significantly 
later  completion  time  relative  to  the  corresponding  analysis  data  cutoff  time. 


2.3.2  Forecast  Cases  for  Objective  (b)  (Cases  D-F) 

Case  D:  The  GPS  and  NP7  total  cloud  forecasts  labeled  D  in  Table  1  were 
compared  to  answer  the  first  part  of  objective  (b) ,  wherein  we  once  again 
assume  that  the  7LHFM  and  6LDPE  databases  for  TTZ  are  available  concurrently. 
These  comparisons  measure  the  skill  of  7LHFM-derived  total  cloud  forecasts 
(see  Section  2.2.1)  relative  to  current  SLAYER  production  cloud  forecasts. 

Case  E:  The  GPS  and  NP7  total  cloud  forecasts  labeled  E  in  Table  1  were 
compared  to  answer  the  second  part  of  objective  (b) ,  wherein  we  seek  to 
measure  the  effect  of  a  6-hour  offset  (delayed  availability)  in  the  7LHFM 
versus  the  6LDPE  database  time. 

Case  F:  The  GP5  and  NP7  total  cloud  forecasts  labeled  F  in  Table  1  also 
were  compared  to  answer  the  second  part  of  objective  (b) ,  but  here  we  seek  to 
measure  the  impact  of  a  12-hour  offset  in  the  7LHFM  versus  the  6LDPE  database 
time  of  availability. 

2.3.3.  Overview  of  Case  Comparisons 

We  emphasise  that  the  following  results  from  Cases  A-C,  objective  (a),  and 
Cases  D-F,  objective  (b) ,  must  be  interpreted  within  two  different  contexts. 
Cases  A-C  represent  tests  of  5 LAYER  sensitivity  to  input  motion  field 
accuracy.  Strictly  speaking.  Cases  A-C  do  not  represent  a  cloud  forecast 
model  comparison,  but  rather  a  test  of  the  sensitivity  of  a  single  cloud 
forecast  model  to  inputs  from  two  previously  compared  wind  models  having 
well-known  relative  RMSVE  characteristics.  On  the  other  hand.  Cases  D-E 
represent  a  comparison  of  the  ability  of  two  separate,  independent 
analysis/forecast  systems  (as  configured  at  data  archival  time)  to  provide 
skillful  global  cloud  forecasts.  Briefly,  the  AFGWC  system  (Tarbell  and  Hoke, 
1979)  consists  of  the  HUFANL/6LDPE  analysis-forecast  subsystem  for  the  winds, 
temperatures,  and  heights,  which  are  then  used  in  a  separate  3DNEPH/5LAYER 
subsystem  for  moisture  and  clouds.  The  NMC  system  (as  configured  during  the 
test  peiod)  consists  of  a  single  HUFANL/7LHFM  analysis-forecast  system  for 
winds,  temperatures,  heights,  and  moisture  (McPherson,  1980) . 

2.4  Forecast  Verification  Procedures 

Throughout  the  28-day  test  period,  the  half-mesh  (100  nm)  SLAYER  initial 
0-hour  total  cloud  fields  available  at  00Z  plus  every  3  hours  were  archived 
and  subsequently  used  to  accomplish  grid-to-grid  verification  of  all 
concurrently  valid  GP5,  GTS,  and  NP7  forecasts  in  Table  1.  SLAYER  half-mesh 
initial  total  cloud  fields  actually  represent  a  horizontal  compaction 
(weighted  areal  average)  of  the  corresponding  eighth-mesh  (25  nm)  3DNEPH 
objective  cloud  analysis.  In  this  sense  then,  all  verifications  were 
performed  against  the  3DNSPH. 
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Table  1.  Si 
for  details 


,ry  of  production  and  test  forecasts  used  to  evaluate  stated  objectives.  See  text 


initial 

Driving  Notion 

Max  Fcst 

Offset 

Intended 

Case 

Moisture 

Forecast  Model 

Field  Input 

to  SLAYER 

Projection 

Tis« 

Objective 

A 

(GP5) 

3DNEPH 

(03*) 

SLA YEA 

(03Z) 

AFGWC 

6LDPE 

(00Z) 

48 

N/A 

(a) 

A 

(GT5) 

3DNEPH 

(03*) 

SLAYER 

(03*) 

NMC 

7LHFN 

(00Z) 

48 

0 

(a) 

B 

(GPS) 

3DNEPH 

(09Z) 

SLAYER 

(09*) 

AFGWC 

SLOPE 

(OSS) 

3S 

N/A 

(a) 

B 

(GTS) 

30NEPH 

(09Z) 

SLAYER 

(09*) 

NMC 

7LHPM 

(00K) 

36 

6 

(a) 

C 

(GPS) 

30NBPH 

(1SZ) 

5LAYER 

(15*) 

AFGWC 

6LDPE 

(122) 

36 

N/A 

(a) 

C 

(GTS) 

3DNEPH 

(15Z) 

5 LAYER 

(15Z) 

NMC 

7LHFM 

(00Z) 

36 

12 

(a) 

D 

(GP5) 

3DNBPH 

(03*) 

SLAYER 

(032) 

AFGWC 

6LDPB 

(00Z) 

48 

N/A 

(b) 

0 

(NP7) 

HUFANL 

(00Z) 

7LHFM 

(00Z) 

N/A 

48 

0 

(b) 

B 

(GPS) 

3DNBPH 

(09*) 

SLAYER 

(09Z) 

AFGWC 

6LDPE 

(0SZ) 

36 

N/A 

(b) 

B 

(NP7) 

HUFANL 

(00Z) 

7LHFM 

(00Z) 

N/A 

36 

6 

(b) 

f 

(GP5) 

3DNBPH 

(15*) 

5 LAYER 

(15*) 

AFGWC 

SLOPE 

(12Z) 

36 

N/A 

(b) 

r 

(NP7) 

HUFANL 

(00Z) 

7LHFM 

(00Z) 

N/A 

36 

12 

(b) 
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2.4.1  Verification  Areas 

Within  the  SLAYER  octagon  domain,  two  verification  areas  were  defined  for 
this  study  and  are  denoted  in  Figure  3  as  the  "fronthalf*  area  (FH)  and  the 
"backhalf "  area  (BH) ,  which  respectively  encompass  the  North  American  and 
Eurasian  land  masses,  within  each  of  the  FH  and  BH  areas,  a  corresponding 
limited  area,  FHL  and  BHL  respectively,  was  defined  by  verifying  only 
extratropical  grid  points  north  of  about  30°N.  The  motivation  for  defining 
the  additional  limited  areas  is  discussed  in  later  sections. 

2.4.2  Verification  Sample  Size 

The  FH  and  BH  areas  contained  nearly  equal  numbers  of  half-mesh  grid 
points  (23S8  in  FH  and  2306  in  BH) .  For  the  limited  areas  FHL  and  BHL,  the 
grid-point  totals  are  62%  and  65«  of  the  FH  and  BH  totals  respectively.  When 
verifying  over  any  of  the  four  areas  defined  for  this  study,  we  verified  all 
half-mesh  grid  points  within  the  defined  area.  Therefore,  for  each  set  of  14 
separate  executions  of  each  model  (GP5,  GT5,  and  NP7)  for  each  given  basetime 
in  Table  1  (00Z,  09Z,  and  15Z  for  GP5  and  GT5  and  00Z  for  NP7) ,  a  total 
verified  sample  of  33,012  points  (PH)  or  32,284  points  (BH)  was  generated  for 
each  forecast  projection  (e.g.,  a  24-hour  forecast).  The  FHL  and  BHL  totals 
respectively  are  obtained  from  the  latter  totals  using  the  previously  given 
percentages.  Finally,  to  measure  the  temporal  sampling  dependence  in  the 
statistics,  each  14-day  sample  was  divided  into  two  7-day  samples 
corresponding  to  the  first  and  second  half  of  the  14-day  test  period. 

2.4.3  Verification  Parameters 

At  each  half-mesh  grid  point  in  the  5LAYER  octagon  domain,  each  of  the 
GP5,  GT5,  and  NP7  total  cloud  forecasts  consists  of  a  cloud  amount  value  (in 
whole  percent,  ranging  continuously  from  0-100).  This  value  is  treated  in 
applications  as  the  percent  of  the  respective  100  nm  square  half-mesh  grid  box 
that  is  covered  by  cloud.  For  verification  purposes,  the  cloud  amount 
percentage  is  rounded  to  the  nearest  multiple  of  5  percent. 
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In  the  verification  procedure  used  for  this  study,  we  paired  the  gridded 
forecast  cloud  amounts,  F,  point  by  point  with  the  corresponding  0-hour 
gridded  analysis  cloud  amounts.  A,  for  the  given  forecast  valid  time.  From 
the  resulting  sample  of  errors  (F-A)  (see  Section  2.4.2  for  sample  size),  we 
derived  the  bias,  root  mean  square  error  (RMSE) ,  standard  deviation  of  the 
error  (STDB) ,  linear  correlation  coefficient,  and  the  25/25  score.  This 
latter  score  is  the  primary  accuracy  measure  used  in  this  study  and  will  be 
defined  in  the  next  section.  The  other  statistical  parameters  are  standard. 
We  should  emphasize  here  that  although  the  frequency  of  occurrence 
distribution  of  cloud  amount  is  quasi-binary  (dominated  by  the  clear  and 
overcast  ends  of  the  range  of  cloudiness) ,  the  distribution  of  sample  errors, 
E»F-A,  is  nearly  normal.  The  frequency  distribution  for  E  cannot  be  strictly 
normal,  however,  because  here  E£100  and  thus  the  tails  of  the  distribution 
are  truncated. 
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The  25/25  score  is  defined  as  the  number,  R,  of  "correct”  grid  point 
forecasts  divided  by  the  total  nuaber ,  T,  of  verified  grid  points  in  the 
saaple.  A  forecast  total  cloud  amount,  F,  for  a  given  grid  point  is 
considered  "correct”  if  F  is  within  +25  percent  of  its  paired  verifying 
analysis  amount,  At  that  is,  if  B  d  25.  The  ratio  R/T  is  multiplied  by  100  to 
yield  a  final  percent  correct  score.  Quantitatively  then,  we  define 

(3)  25/25  Score  -  (R25/T)xl00  , 

where  the  subscript  on  R2s  denotes  the  dependence  of  R  on  the  chosen  error 
tolerance.  A  perfect  25/25  score  of  100  percent  indicates  that  E*25  at  all 
grid  points  in  the  verified  saaple.  clearly,  we  can  define  scores  analogous 
to  equation  (3)  for  other  choices  of  the  error  tolerance.  For  larger 
(saMller)  error  tolerances,  R  and  the  percent  correct  will  increase 
(decrease) .  We  have  chosen  a  rather  liberal  error  tolerance  here  for  two 
reasons.  First,  previous  cloud  model  comparison  studies  have  shown  that  the 
25/25  score  is  the  aost  sensitive  indicator  of  its  type.  That  is,  the 
greatest  spread  in  percent  correct  scores  among  various  test  forecast  cases 
tends  to  be  in  the  25/25  score.  Secondly,  the  objective  0-hour ,  ha If -mesh, 

6P5  gridded  total  cloud  analysis  used  as  the  verifying  field  is  not  perfectly 
reliable,  because  it  is  derived  from  the  objective  3DNKPH  analysis.  Like  any 
objective  analysis  aodel,  the  3DNEPH  has  certain  characteristic  errors.  The 
impact  of  these  errors  on  the  statistics  obtained  here  is  discussed  further  in 
Section  3.1.1. 

A  faailiar  skill  score  can  be  derived  by  comparing  the  25/25  score  of  a 
forecast  saaple  to  the  25/25  score  of  the  saaple 's  persistence  forecast.  Here 
in  this  study,  we  use  the  skill  score,  S,  given  by 

(4)  S25  »  (R25  -  P25>  /  (T  -  P25) , 

where  P2j  1*  the  nuaber  of  persistence  forecast  points  at  which  B  £  25. 


FORECAST  COMPARISON  RESULTS 


*1  Forecast  comparisons  for  Objective  (b)  (Cases  A-C) 

3.1.1  Preliminary  Consider at ions 

Before  we  evaluate  the  impact  of  using  7LHFM  versus  6 LOPE  as  the  source  of 
SLAYER  input  forecast  winds,  we  must  estimate  the  upper  limit  on  the 
improvement  in  5 LAYER  skill  that  one  may  expect.  Ne  need  this  limit  in  order 
to  judge  the  significance  of  a  given  increase  in  forecast  accuracy  resulting 
from  improved  winds.  Prom  the  5LAYBR  forecast  study  by  Garrison  (1974) ,  we 
estimate  that  the  sources  of  a  typical  STDB  of  33  percent  cloud  for  a  24-hour 
SLAYER  total  cloud  forecast  may  be  given  as  follows « 

Contribution  to  the 

24-hour  SLAYER  8TPE  Error  Source 

8  Gridding  and  interpolation  operations 

11  Shortcomings  in  cloud  model  physics 

6  Errors  in  initial  or  verifying  3 DNEPR 

objective  analysis 

8  Input  wind  forecast  inaccuracies 

33  Total  STDB 

The  study  by  Garrison  (1974)  gives  a  detailed  example  of  how  cloud  forecast 
errors  arise  from  gridding  and  interpolation  operations.  Here,  we  shall 
discuss  briefly  the  other  sources  of  SLAYER  forecast  error  given  above. 

Shortcomings  in  SLAYER  model  physics  include,  for  example,  insufficient 
representation  of  boundary-layer  cloud  processes  (such  as  fair-weather  cumulus 
and  radiation  fog)  and  a  lack  of  an  explicit  treatment  of  liquid  cloud  water. 
These  and  other  shortcomings  in  model  physics  owe  largely  to  the  computational 
constraint  whereby  the  model  execution  time  must  meet  daily  production 
deadlines.  This  computational  constraint,  which  precludes  inclusion  of  the 
complex  algorithms  of  certain  physical  processes,  is  in  turn  a  strong  function 
of  the  limitations  of  the  computer  hardware  being  utilised. 

SLAYER  forecast  errors  also  arise  from  errors  in  the  3DNEPH  cloud 
analysis,  which  provides  both  the  initial  and  verifying  cloud  fields  for 
SLAYER.  In  areas  of  sparse  conventional  data,  the  3 DNEPR  is  unable  to  discern 
low-lqvel  cloud  underlying  a  higher  level  overcast,  which  in  this  case  will  be 
the  only  cloud  deck  represented  in  the  video  and  infrared  satellite  data. 

Also,  in  conventional  data-sparse  regions,  the  3DNEPH  analysis  is  largely 
persisted  over  the  several  analysia  cycles  that  may  occur  between  successive 
satellite  passes,  yor  the  DMSP  satellite  configuration  that  existed  during 
the  test  period,  up  to  8  hours  separated  successive  satellite  passes  over  any 
given  area  during  certain  perioda  of  the  day.  The  resulting  tendency  in  the 
3DNRPH  toward  persiatence  during  theae  periods  in  data-sparse  regions  somewhat 
distorts  the  short-range  forecast  statistics  in  this  study,  m 


expect,  then,  that  tha  6-hour  persistence  forecast  scores  are  anomalously 
inflated,  while  the  6-hour  aodel  forecast  scores  are  anosuilously  degraded.  It 
is  difficult  to  quantify  the  statistical  iapact  arising  from  persisted  regions 
in  the  3DMBPH  verification  fields.  However,  we  suspect  it  is  not  large  for 
forecast  periods  beyond  12-hours. 

Our  primary  interest  in  objective  (a),  however,  is  in  the  last  SLAYER 
error  source  listed  above,  naaely,  errors  arising  froa  inaccuracies  in  the 
input  forecast  winds.  The  8  percent  estiaate  given  above  in  this  category  was 
deterained  froa  the  'perfect  prog"  SLAYER  study  (Garrison,  1974)  in  which 
actual  objective  upper-air  wind  analyses  were  used  as  input  to  SLAYER  in  place 
of  the  wind  aodel  forecasts.  Thus,  an  8  percent  reduction  in  STDE  is  the 
extreae  upper  liait  in  iaproveaent  that  one  can  reasonably  expect  in  SLAYER  by 
using  iaproved  forecast  winds.  In  this  regard,  we  note  that  when  the  AMS 
6LOPB  aodel  replaced  the  quasi-geostrophic  6LVL  aodel  in  1975,  the  5LAYBR 
aonthly  STDE  values  only  dropped  about  3  percent  in  the  subsequent  winter 
aonths  and  only  1.5  percent  in  the  subsequent  suaaer  aonths.  Overall  then, 
because  the  period  of  the  present  study  was  late  suaaer,  we  estiaate  that  on 
the  order  of  only  a  1-2  percent  drop  in  the  5LAYER  24-hour  STDE  values  will  be 
obtained  here  when  we  replace  the  6LDPE  input  with  that  of  the  7LHFM. 

To  produce  a  Meaningful  evaluation  of  the  sensitivity  or  response  of 
SLAYER  to  iaproved  7LHFM  wind  output,  we  aust  quantify  the  RMSVE  reduction  in 
the  7LHFM  over  the  6LDPE;  that  is,  we  aust  measure  how  much  better  the  7LHFM 
winds  are  than  6LDPE  winds.  Optiaally  for  this  purpose,  we  night  have 
coopered  the  RMSE  values  obtained  froa  a  special  verification  of  the  14 
specific  00Z  7LHFM  and  6LDPE  databases  actually  used  in  the  Case  A  (see  Table 
1).  This  was  not  done,  however,  because  of  the  associated  increase  in  the 
volume  of  archived  data  required.  Instead,  we  give  the  routine  Monthly  RMSVE 
values  (as  derived  froa  a  coaaon  standard  set  of  102  Northern  Hemisphere  RAOB 
stations)  for  the  7LHPM,  6LDPE,  and  station  persistence  for  the  combined 
months  of  August  and  September  1979,  which  include  the  test  period.  These 
RMSVE  values  are  given  as  a  function  of  forecast  length  in  Figures  4-6  for  the 
850,  500,  and  250  mb  levels  respectively.  The  14  7LHFM  and  6LDPB  00Z 
databases  used  in  Case  A  represent  about  12  percent  of  the  122+2  7LHFM  and 
6LDPE  databases  from  which  Figures  4-6  were  derived.  The  availability  of 
comparative  statistics  deterained  the  choice  of  pressure  levels  shown  in 
Figures  4-6.  The  SLAYER  aodel  specifically  utilizes  u,  v,  and  oaega  wind 
components  at  the  1000,  850,  700,  500,  and  300  ab  levels. 

Figures  4-6  also  give  the  percent  reduction  in  the  7LHFM  versus  the  6LDPE 
RMSVE.  Overall,  these  figures  show  a  7LHFM  RMSVE  reduction  of  around  14 
percent  when  averaged  over  the  given  levels  and  forecast  intervals. 
Alternatively,  we  aay  interpret  Figures  4-6  as  showing  that  the  7LHFM  forecast 
of  length  TT  +  At  hours  has  the  same  RMSVE  accuracy  as  the  6LDPE  forecasts  of 
length  TT  hours.  The  At  'forecast  extension'  here  is  obtained  by  translating 
each  point  on  the  7LHFM  RMSVE  curves  to  the  right  by  an  interval  At  until 
coincidence  with  the  6LDPE  RMSVE  curve  is  achieved.  Figures  4-6  show  a 
ainiaua  7LHFM  versus  6LDPB  At  value  of  12  hours.  In  the  next  section  we 
evaluate  tha  cooperative  verification  statistics  obtained  froa  Cases  A-C  in 
Table  1  and  then  we  establish  to  what  extent  this  increase  in  7LHFM  versus 
SUM  skill  translates  into  Measured  improvements  in  SLAYER  total  cloud 
forecast  accuracy. 
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Figure  4.  850  mb  root  mean  square  vector  error  (RMSVE)  for  7LHFM,  6 LOPE,  and  station  persistence  and 

7LHFM  percent  RMSVE  reduction  as  a  function  of  forecast  length  for  102  Northern  Hemisphere 
RAOB  stations  during  August-September  1979. 


Figure  6.  As  in  Figure  4  but  for  250  mb. 


3.1.2  Case  A  Results 


The  25/25  scores  for  the  GP5,  GT5 ,  and  persistence  forecasts  labeled  Case 
A  in  Table  1  are  given  as  a  function  of  forecast  length  in  Figures  7,  8,  and  9 
for  the  BH  region  (14-day  set),  BH  region  (latter  7-day  set),  and  BHL  region 
(14-day  set) ,  respectively.  The  corresponding  Case  A  results  for  the  FH  and 
FHL  regions  are  given  in  Figures  10-12. 

Before  9  hours,  the  GPS  and  GT5  25/25  scores  are  nearly  equivalent.  But 
beyond  9  hours  the  GT5  score  is  superior  to  the  GP5  score  throughout  Figures 
7-12.  The  absolute  improvement  in  the  25/25  score  of  GT5  versus  GPS  never 
exceeds  about  3  percent  in  the  BH  cases  or  about  1.5  percent  in  the  FH  cases. 
We  conclude  from  the  figures  that  the  14  percent  RMSVE  reduction  in  the  7LHFM 
versus  the  6LDPE  wind  field  forecasts  has  translated  roughly  into  an  order  of 
magnitude  smaller  absolute  improvement  in  the  total  cloud  25/25  score  of  the 
SLAYER  model. 

It  is  important,  however,  that  we  also  consider  the  improvment  in  GT5 
versus  GP5  25/25  score  relative  to  persistence.  In  Figure  7,  for  the  overall 
BH  case,  we  find  at  24  hours  and  beyond  at  least  a  doubling  of  the  spread 
between  the  model  forecast  and  persistence  curves  in  the  GT5  case  versus  the 
GP5  case.  Inspection  of  equation  (4)  shows  that  the  GT5  25/25  skill  score  is 
thus  twice  that  of  GP5  for  the  14-day  BH  case.  This  is  shown  graphically  in 
Figure  13,  which  is  the  skill-score  plot  corresponding  to  Figure  7.  Figure  14 
shows  the  FH  skill-score  plot  corresponding  to  Figure  10.  It  is  apparent  in 
Figure  14  that  the  GT5  versus  GP5  skill-score  improvement  in  the  FH  case  was 
substantially  less  than  in  the  BH  case  in  Figure  13. 

We  also  note  in  comparing  Figures  9  and  12  with  Figures  7  and  10 
respectively,  that  both  the  GP5  and  GT5  25/25  scores  are  larger  relative  to 
persistence  (thus  implying  greater  skill  scores)  in  the  limited  versus  full 
verification  areas,  owing  to  the  lower  persistence  25/25  scores  in  the  limited 
areas.  This  result  agrees  with  routine  monthly  5 LAYER  statistics,  which 
consistently  show  lower  persistence  scores  in  extratropical  versus  subtropical 
regions.  The  subtropical  regions  have  been  eliminated  in  the  FHL  and  BHL 
areas.  Thus,  in  the  BHL  area  we  would  not  obtain  a  GT5  skill  score  that  is 
twice  that  of  GP5;  nevertheless,  the  absolute  25/25  score  improvement  in  the 
BHL  and  BH  areas  is  roughly  equivalent.  In  the  FHL  area,  we  find  the  GT5 
absolute  25/25  score  improvement  to  be  larger  than  in  the  FH  area,  but  still 
smaller  than  in  the  BHL  area. 

We  next  consider  the  Case  A  comparisons  for  the  remaining  statistical 
verification  parameters  introduced  earlier.  The  results  of  these  comparisons 
for  the  FH  and  BH  areas  are  presented  in  Table  2  and  for  the  FHL  and  BHL  areas 
in  Table  3.  There  is  a  fairly  consistent  reduction  in  the  GTS  RMSE  and  STDE 
values  relative  to  the  corresponding  GP5  values,  with  the  exception  of  the 
RMSE  values  for  the  entire  FH  area.  Thus,  the  7LHFM  wind  input  in  Case  A  has 
also  improved  the  RMSE  and  STDE  statistics  in  general,  it  is  significant  to 
note  that  while  the  FH-area  values  of  GT5  RMSE  and  STDE  actually  increased 
relative  to  GP5  in  three  of  five  forecast  periods,  the  FHL-area  values  of  GT5 
RMSE  and  STDE  showed  the  largest  consistent  decreases  for  the  24-hour  period 
and  beyond.  Thus,  it  is  clear  here,  and  in  the  previous  25/25  score  results, 
that  the  GT5  forecasts  were  the  least  accurate  over  the  FH  subtropics  area. 
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PERSISTENCE 


Figure  7.  25/25  score  as  a  function  of  forecast  length  for  the  AFGWC  production  5 LAYER  (GP5) ,  the 

AFGWC  test  SLAYER  (GT5) ,  and  persistence  in  Case  A  (Table  1)  for  the  backhalf  (BH)  area 

14-day  set. 


PERSISTENCE 


Figure  B.  AS  in  Figure  7  but  for  the  latter  7-day  set. 


Figure  10.  25/25  score  as  a  function  of  forecast  length  for  the  AFGWC  production  5 LAYER  (GP5) ,  the  AFGWC 
test  SLAYER  (GT5) ,  and  persistence  in  Case  A  (Table  1)  for  the  fronthalf  (FH)  area,  14-day  set 


Figure  11.  As  in  Figure  10  but  for  the  latter  7-day  set. 


Figure  12.  As  in  Figure  10  but  for  the  fronthalf  limited  (FHL)  area. 
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Figure  13.  25/25  skill  score  (using  the  data  in  Figure  7) as  a  function  of  forecast  length  for  the  AFGWC 

production  5 LAYER  (GPS)  and  the  AFGWC  test  5 LAYER  (GT5)  Case  A  (Table  1)  for  the  backhalf  (BH) 
area,  14-day  set.  Also  shown  is  the  GT5  to  GP5  skill-score  ratio. 


Table  2.  Additional  statistical  information  for  Case  A,  the  backhalf  and  fronthalf  areas, 
contrasting  persistence  (PERS) ,  AFGMC  production  (GP5) ,  and  test  (GTS)  SLAYER  cases. 

CASE  A  (BACKHALF  AREA) 


FCST 

LENGTH 

PERS 

RMSE 

GP5 

GT5 

PERS 

STUB 

GP5 

GT5 

PERS 

BIAS 

GP5 

GT5 

LINEAR 

PERS 

CORRELATION 
GP5  GTS 

6 

24.0 

21.9 

21.9 

24.8 

21.9 

21.8 

1.6 

1.7 

2.1 

.755 

.794 

.797 

12 

30.1 

26.7 

26.4 

30.1 

26.7 

26.4 

.1 

.0 

2.1 

.645 

.702 

.712 

24 

32.1 

29.6 

28.8 

32.1 

29. 5 

28.7 

-.3 

-1.7 

1.6 

.603 

.651 

.678 

36 

37.5 

33.2 

32.6 

37.5 

33.1 

32.4 

.0 

-2.4 

3.7 

.450 

.537 

.575 

48 

37.8 

35.4 

35.0 

37.8 

35.3 

34.7 

.1 

-3.2 

4.3 

.452 

.503 

.539 

CASE  A  (FRONTHALF  AREA) 


FCST 

LENGTH 

PERS 

RMSE 

GP5 

GTS 

PERS 

STDE 

GP5 

GT5 

PERS 

BIAS 

GP5 

GT5 

LINEAR  CORRELATION 
PERS  GP5  GTS 

' 

“  "  ™ 

6 

27.5 

26.1 

26.2 

27.4 

26.0 

26.1 

2.4 

1.7 

2.1 

.684 

.699 

.700 

12 

32.6 

29.4 

29.5 

32.5 

29.4 

29.4 

2.2 

1.0 

2.5 

.539 

.603 

.608 

24 

35.2 

32.4 

32.4 

35.2 

32.4 

32.3 

-1.0 

-.8 

2.3 

.456 

.539 

.547 

36 

38.9 

3S.0 

35.1 

38.8 

34.9 

34.6 

2.2 

1.0 

5.7 

.343 

.455 

.474 

48 

39.8 

38.0 

37.6 

39.8 

38.0 

37.2 

.0 

-.7 

5.0 

.303 

.374 

.404 

Table  3.  As  in  Table  2  but  for  the  backhalf  and  fronthalf  limited  areas. 

CASE  A  (BACKHALF  LIMITED  AREA) 


FCST 

LENGTH 


BIAS 

PERS  GPS 


LINEAR  CORRELATION 
PERS  GP5  GTS 


While  reduction  in  GTS  versus  GPS  RMSB  and  STDE  are  fairly  consistent  in 
Tables  2  and  3  after  12  hours,  the  magnitude  of  the  reductions  is  rather 
small.  With  the  exception  of  the  PH  area,  the  remaining  three  areas  in  Tables 
2  and  3  show  an  average  reduction  in  GTS  versus  GPS  STDE  of  about  0.7  percent 
for  the  24-hour  period  and  beyond.  Relative  to  a  typical  24-  to  48-hour  GPS 
STDE  value  of  around  34  percent,  this  0.7  percent  absolute  average  STDE 
reduction  represents  a  percentage  STDE  improvement  of  about  2  percent.  The 
average  reduction  in  GTS  versus  GPS  RMSB  was  somewhat  less,  being  on  the  order 
of  0.5  percent  for  the  BH,  BHL,  and  FHL  areas  beyond  24  hours.  This  absolute 
RMSB  reduction  represents  a  percentage  improvement  of  about  1.5  percent.  Thus 
in  this  study,  the  14  percent  reduction  in  7LHFM  versus  6LDPE  RMSVE  values  has 
generally  translated  into  an  order  of  magnitude  smaller  percentage  reduction 
in  GTS  versus  GPS  RMSB  values.  Although  the  GT5  error  reductions  here  are 
small,  they  appear  statistically  significant.  Although  no  formal  tests  of 
statistical  significance  were  performed  on  the  error  samples,  we  recall  that  a 
0.7  percent  STDE  reduction  is  on  the  order  of  the  1-2  percent  reduction  that 
we  anticipated  in  the  estimates  given  in  Section  3.1.1. 

The  RMSB,  STDE,  and  bias  statistics  in  Table  2  and  3  are  analytically 
related  according  to 

(5)  (RMSB)2  -  (STDE)2  +  (bias)2. 

Equation  (S)  shows  thatif  the  bias  error  is  significant,  then  a  significant 
portion  of  the  total  RMSE  is  attributable  to  bias  errors.  This  fact  is  useful 
to  numerical  modelers,  because  it  is  often  quite  possible  to  find  and  remove 
the  source  of  a  systematic  bias  error  in  model  forecasts  and  thereby  reduce 
the  total  RMSE.  On  the  other  hand,  it  is  usually  much  more  difficult  to 
discover  the  model  source  or  sources  contributing  to  the  STDE. 

In  this  context,  we  shall  examine  the  GT5  bias  errors  in  Table  2  and  3  in 
order  to  evaluate  the  possibility  of  further  GT5  versus  GP5  RMSE  reductions. 

If  the  7LHPM  winds  were  routinely  used  in  5 LAYER,  it  is  likely  that  a 
substantial  portion  of  the  GT5  bias  error  in  Tables  2  and  3  could  be 
eliminated  by  appropriate  model  adjustments.  In  the  current  GPS  model, 
adjustments  have  been  made  which  have  reduced  the  bias  error  in  most  verified 
regions  to  less  than  2.5  percent  at  36  hours  or  less. 
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ffe  see  in  Table  2  and  3  that  the  GTS  bias  error  at  36  hours  is  as  high  as 
5.7  percent  in  the  FH  area  and  at  36  hours  is  never  less  than  3  percent  in  any 
area.  To  determine  the  cloudiness  range  in  which  most  of  the  GT5  bias  error 
is  present,  we  show  in  Figures  15-16  and  Figures  17-18  the  24-  and  48-hour 
forecast  cloud  amount  frequency  of  occurrence  curves  for  the  FH  and  BH  regions 
respectively.  In  these  figures,  seven  discrete  cloud  amount  categories  were 
utilised.  To  construct  the  figures,  a  given  forecast  or  verifying  cloud 
amount,  which  we  recall  may  fall  in  the  range  0-100  percent,  is  simply 
assigned  to  the  closest  of  the  seven  discrete  category  values.  The  final 
number  of  occurrences  in  each  category  is  divided  by  the  entire  sample  total, 
T,  and  then  multiplied  by  100  to  yield  the  percent  frequency  of  occurrence. 

In  Figures  15-18,  the  dominant  feature  is  the  large  positive  GT5  bias  in 
the  "overcast"  category  of  95  percent.  Clearly,  this  large  overcast  bias 
continues  to  grow  as  the  forecast  length  increases,  which  largely  accounts  for 
the  overall  growth  of  the  GT5  bias  error  in  forecast  time  in  Tables  2  and  3. 
This  tendency  in  the  GT5  forecasts  to  increase  the  extent  of  overcast  cloud  is 
an  apparent  response  to  the  7LHFM  forecast  vertical  motion.  Since  the  primary 
cloud  generating  mechanism  in  5LAYBR  is  upward  displacements  in  the  calculated 
three-dimensional  parcel  trajectories,  the  tendency  toward  increasing  cloud  in 
GT5  forecasts  is  most  likely  a  response  to  more  extensive  and  intense  areas  of 
upward  motion  in  the  7LHFM  versus  the  6LDPE.  This  might  be  expected  from  the 
fact  that  the  moist  7LHFM  model,  unlike  the  6LDPE,  includes  latent  heating 
effects.  These  tend  to  enhance  the  vertical  motion  mechanisms  that  depend  on 
heating.  He  did  not  specifically  compare  6 LOPE  and  7LHPM  input  vertical 
motion  fields  in  this  study  and  thus  we  could  not  further  pursue  this 
hypothesis. 
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Figure  15.  Total  cloud  frequency  distribution  for  the  AFGWC  production  5 LAYER  (GP5)  and  the  AFGWC  test 
5LAYER  (GT5)  24-hour  forecasts  and  verifying  analysis  in  Case  A  (Table  1)  for  the  fronthalf 
(FH)  area,  14-day  set. 
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3.1.3  Case  B-C  Results 

In  the  Case  A  comparisons  described  in  Section  3.1.2,  we  assumed  that  the 
7LHFM  and  6LDPE  00Z  databases  were  available  concurrently  for  input  into  the 
03Z  5 LAYER .  In  this  section,  we  assume  that  the  0-hour  basetime  of  the  7LHFM 

database  is  either  6  hours  older  (Case  B  comparisons)  or  12  hours  older  (Case 
C  comparisons)  than  the  0-hr  basetime  of  the  6LDPE  database  that  is  used  in 
the  current  production  5LAYER.  The  details  of  the  various  7LHFM  and  6 LOPE 
databases  used  in  5LAYER  for  the  Case  B  and  C  comparisons  are  given  in  Table 
1.  The  motivation  for  the  Case  B  and  C  comparisons  was  given  toward  the  end 
of  Section  3.1.1,  in  which  we  showed  that  the  reduction  in  the  RMSVE  of  the 
7LHFM  versus  6L0PE  wind  forecasts  could  be  viewed  as  a  7LHFM  12-hour  forecast 
extension  relative  to  the  6LDPE.  He  want  to  determine  here  whether  this  7LHFM 
versus  6LDPE  12-hour  forecast  extension  will  translate  also  into  a  GTS  versus 
GPS  12-hr  forecast  extension. 

The  2S/25  scores  for  the  GP5,  GT5,  and  persistence  forecasts  are  given  as 
a  function  of  forecast  length  in  Figures  19  and  20  for  the  FH  and  BR  regions, 
respectively,  for  Case  B  in  Table  1  and  in  Figures  21  and  22  for  the  FH  and  BH 
regions,  respectively,  for  Case  C  in  Table  1.  In  the  following  discussion,  it 
is  useful  to  compare  Figures  19  and  21  (BH  region)  and  Figures  20  and  22  (FH 
region)  with  Figure  7  (BH  region.  Case  A)  and  Figure  10  (FH  region,  Case  A) . 

Figure  19  and  Figure  20  show  that  the  superior  accuracy  of  GT5  versus  GP5 
forecasts  found  in  Case  A  continues  also  in  Case  B,  although  as  expected,  the 
extent  of  the  superiority  is  reduced.  Whereas  in  Case  A  the  GT5  versus  GPS 
absolute  25/25  score  improvement  was  about  3  percent  and  1.5  percent  in  the  BH 
and  FH  regions,  respectively,  for  forecasts  beyond  9  hours#  the  corresponding 
Case  B  improvement  in  Figures  19  and  20  averages  only  about  0.5  percent  and 
0.3  percent  in  the  BH  and  FH  regions,  respectively.  The  superiority  of  GT5 
versus  GP5  forecasts  in  Case  B  is  supported  also  by  the  statistics  compared  in 
Table  4.  Aside  from  the  poorer  GT5  bias  values,  the  GT5  RMSE,  STDE,  and 
linear  correlation  statistics  are  superior,  albeit  sometimes  only  slightly, 
than  the  corresponding  GP5  statistics  (with  the  single  exception  of  the  BH 
region  36-hour  RMSE  values).  Comparing  Table  4  with  Table  2,  we  find  in  the 
BH  region  that  the  GT5  versus  GP5  average  STDE  reduction  of  0.1  percent  over 
the  12-  to  36-hour  forecast  range  in  Case  A  has  actually  increased  to  0.4 
percent  in  Case  B.  We  can  present  no  obvious  reason  for  the  latter  unexpected 
increase.  However,  the  important  overall  result  here  is  that  in  Case  B,  GTS 
total  cloud  forecasts  are  consistently  more  accurate  than  GP5  forecasts, 
despite  GT5  7LHFM  input  being  6  hours  older  than  GP5  6 LOPE  input. 

As  might  be  expected,  the  results  are  less  straightforward  in  Case  C. 
Figure  21  shows  that  the  GTS  and  GP5  25/25  scores  over  the  BH  region  are 
essentially  equivalent  for  all  forecast  periods  shown.  Table  5  shows  that  the 
GTS  RMSE  and  STDE  values  over  the  BH  region  are  less  than  the  GP5  values  only 
for  forecast  periods  less  than  about  24  hours.  On  the  other  hand,  the  GP5  and 
GTS  linear  correlation  values  over  the  BH  region,  like  the  25/25  scores,  are 

essentially  equivalent  for  all  the  forecast  periods.  The  Case  C  results  for 

the  FH  region  more  clearly  favor  the  GT5  forecasts.  Figure  22  and  Table  5 
show  that  the  25/25  score,  RMSE,  STDE  and  linear  correlation  values  for  the 
GT5  forecasts  are  essentially  equivalent  or  slightly  superior  to  the 
corresponding  GP5  values  for  all  forecast  periods  in  the  FH  region.  Overall 
then,  we  can  generally  conclude  in  Case  C  that  GT5  total  cloud  forecast 

accuracy  is  essentially  equivalent  to  GP5  total  cloud  forecast  accuracy,  with 

some  slight  degradation  at  36  hours  and  (we  anticipate)  also  at  48  hours. 
Equivalently,  we  may  state  that  the  7LHFM  versus  6LDPE  12-hour  forecast 
extension  roughly  translates  into  a  CT5  versus  GP5  12-hour  forecast  extension. 


Figure  22.  As  in  Figure  19  but  for  Case  C  (Table  1)  and  the  fronthalf  (FH)  area 


Table  4.  Additional  statistical  information  for  Case  B,  the  backhalf  and  fronthalf  areas 
contrasting  persistence  (PERS) ,  AFGWC  production  (GPS),  and  test  (GT5)  5 LAYER  cases. 
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STDE 

GPS 

GT5 

PERS 

BIAS 

GP5 

GT5 

LINEAR 

PERS 

CORRELATION 
GP5  GTS 

6 

24.6 

22.5 

22.4 

24.6 

22.5 

22.4 

-1.5 

-.2 

1.3 

.754 

.784 

.785 

12 

30.1 

26.4 

26.4 

30.0 

26.4 

26.2 

2.1 

1.0 

3.4 

.652 

.720 

.726 

24 

30.0 

27.9 

27.4 

30.0 

27.9 

27.3 

.0 

-1.3 

3.0 

.628 

.670 

.696 

36 

37.4 

33.6 

34.0 

37.3 

33.5 

33.4 

2.1 

-1.1 

6.2 

.462 

.547 

.569 

CASE  B 

(FRONTHALF  AREA) 

FCST 

RMSE 

STDE 

BIAS 

LINEAR 

CORRELATION 

LENGTH 

PERS 

GPS 

GT5 

PERS 

GP5 

GT5 

PERS 

GP5 

GTS 

PERS 

GP5 

GTS 

6 

27.3 

25.1 

24.9 

27.3 

25.1 

24.9 

-.2 

.3 

1.0 

.690 

.713 

.718 

12 

32.5 

28.5 

28.2 

32.5 

28.5 

28.2 

-.4 

-.2 

1.0 

.547 

.614 

.626 

24 

36.6 

33.6 

33.4 

36.6 

33.6 

33.2 

-.3 

.3 

3.3 

.460 

.534 

.548 

36 

39.8 

35.2 

35.2 

39.8 

35.2 

34.7 

.7 

.8 

5.5 

.325 

.430 

.457 

Table  5.  As  in  Table  4  but  for  Case  C. 


CASE  C  (BACKHALF  AREA) 
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1 

6 

23.9 

22.4 

22.4 

23.7 

22.2 

22.2 

3.7 

3.1 

3.2 

.786 

.803 

.805 

12 

29.2 

25.9 

25.8 

29.2 

25.9 

25.8 

-.1 

.1 

.4 

.663 

.721 
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24 

32.7 

29.3 

29.8 

32.7 

29.3 

29.7 

-.1 

.4 

2.6 

.573 

.649 
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36.4 

32.2 

33.2 

36.4 

32.2 

33.0 

.0 

-.6 

3.7 

.480 

.574 

.570 

CASE  C  (FRONTHALF  AREA) 


3.2.1  Preliminary  Considerations 

As  pointed  out  in  Section  2.3.3,  Cases  D-F  in  Table  1  represent  a 
comparison  of  the  total  cloud  forecast  capability  of  two  separate,  independent 
analysis/forecast  systems;  namely,  the  AFGWC  system  (Tarbell  and  Hoke,  1979) 
and  the  NNC  system  (McPherson,  1980).  We  shall  summarize  here  several  crucial 
differences  between  the  NMC  and  AFGWC  systems  in  regard  to  moisture  and  cloud 
forecasts. 

The  NMC  system  does  not  include  an  analog  to  AFGWC 's  3DNEPH/5LAYER  cloud 
analysis/forecast  subsystem.  Rather,  during  the  period  of  this  test,  NMC 
moisture  field  forecasts  (RH,  QPF,  etc.)  were  obtained  directly  from  the  NMC 
7-layer  moist  PE  model.  The  main  differences  between  NMC's  7LHFM  pe  forecast 
model  and  AFGWC 's  6LDPE  forecast  model  were  given  in  Section  1.  There  are 
also  important  differences  between  the  two  systems  in  the  data  sources  used  to 
derive  the  initial  moisture  fields.  At  NMC,  global  upper-air  mosture  analyses 
are  derived  almost  solely  from  conventional  RAOB  data.  The  one  significant 
exception  to  this  is  in  the  North  American  region  comprising  the  domain  of 
NMC's  LFM  II  regional  model.  In  the  land  areas  of  the  LFM  n  region,  the  NMC 
analysis  system  empirically  converts  surface-based  cloud  reports  into  relative 
humidity  profiles.  In  ocean  areas  of  the  LFM  II  region,  the  NMC  analysis 
system  incorporates  relative  humidity  profiles  derived  by  manual,  empirical 
methods  that  use  visible  and  infrared  satellite  cloud  imagery  (Smigielski  et. 
al.  1978) .  The  crucial  point  here  is  that  conventional  cloud  reports  or 
satellite  cloud  imagery  is  used  in  the  NMC  moisture  analysis  only  in  one 
limited  Northern  Hemisphere  area.  Equally  significant  here  is  the  fact  that 
the  Northern  Hemisphere  7LHFM  initial  moisture  fields  south  of  about  20°N 
were  initialized  with  artificial,  arbitrarily  dry,  relative  humidity  values 
apparently  to  minimize  boundary  problems. 

In  contrast  to  the  moisture  analysis  procedures  at  NMC,  the  initial  5LAYER 
moisture  fields  in  both  hemispheres  are  derived  at  AFGWC  almost  solely  on  the 
basis  of  the  global,  objective,  gridded  cloud  amounts  provided  by  the  3DNEPH 
cloud  analysis.  The  analyses  produced  by  the  3DNEPH  package  rely  primarily  on 
visible  and  infrared  satellite  cloud  imagery  and  conventional,  surface-based 
cloud  reports  and  only  secondarily  on  upper-air  RAOB  moisture  data.  Briefly, 
the  5LAYER  initial  CPS  moisture  field  is  derived  by  compacting  the  high 
resolution  (eight-mesh)  3DNEPH  cloud  analysis  to  the  coarse  (half-mesh) 
resolution  of  SLAYER  and  then  converting  the  compacted  non-zero  cloud  amounts 
to  CPS  using  the  empirical  curves  of  Figure  1.  At  those  relatively  few, 
strictly  cloud-free  grid  points  of  the  3DNEPH,  a  different  procedure  is  used 
to  yield  CPS  values  that  instead  reflect  conventional  upper-air  RAOB  moisture 
values  (Friend  and  Mitchell,  1982).  Overall  then,  the  5LAYER  initial  CPS 
moisture  fields  directly  reflect  the  global  cloud  cover  distribution.  Owing 
to  this  difference  in  the  extent  to  which  NMC  and  AFGWC  use  conventional  cloud 
reports  and  satellite  cloud  imagery  in  their  initial  moisture  analyses,  the 
cloud  forecast  comparisons  in  Case  D  will  serve  to  define  the  value  of  initial 
cloud  data  as  well  as  the  value  of  using  an  advanced  prediction  model. 


3.2.2  Case  D  Results 


The  25/25  scores  for  the  GP5,  NP7 ,  and  persistence  forecasts  labeled  Case 
D  in  Table  1  are  given  as  a  function  of  forecast  length  in  Figures  23,  24,  and 
25  for  the  BH  region  (14-day  set),  BH  region  (first  7-day  set),  and  BHL  region 
(14-day  set)  respectively.  The  correspnding  Case  D  results  for  the  FH  and  FHL 
regions  are  given  in  Figures  26,  27,  and  28.  The  NP7  and  persistence  data  is 
plotted  at  6  hourly  intervals  because  of  its  availability,  versus  Case  A, 
Figures  7-12  which  have  only  12  hourly  forecast  data  available  after  the 
initial  period. 

Figures  23-28  show  that  the  GP5  25/25  scores  are  substantially  higher  than 
the  NP7  25/25  scores  for  forecast  periods  less  than  24  hours.  This  result  is 
a  consequence  of  the  large  initial  difference  between  the  0-hour  GP5  and  HP7 
total  cloud  fields.  This  latter  difference  can  be  viewed  as  showing  that  the 
initial  0-hour  NP7  Moisture  analysis  (after  conversion  to  CPS  and  then  to 
total  cloud  by  the  Methods  of  Section  2.2.1)  does  not  reliably  reflect  the 
heMispheric  cloud  cover  as  analyzed  by  the  compacted  3 DNEPR  cloud  analysis 
(which  provides  the  0-hr  GPS  initial  total  cloud) .  As  is  apparent  in  Figures 
25  and  28,  this  initial  difference  is  still  large,  though  significantly 
reduced,  when  we  verify  only  over  the  FHL  and  BHL  areas,  in  which  we  have 
eliMinated  the  arbitrarily  dry  subtropical  areas  of  the  7LHFM  initial  moisture 
fields.  We  note  in  the  BHL  and  FHL  results  of  Figures  25  and  28  that  the 
0-hour  disparity  between  GP5  and  NP7  initial  cloud  fields  is  larger  in  the  FHL 
region  than  in  the  BHL  region,  despite  the  use  by  NMC  of  satellite  cloud 
iMagery  and  surface-based  cloud  reports  to  augMent  the  0-hour  7LHFM  initial 
moisture  fields  in  the  FHL  area. 

We  observe  in  Figures  23  through  28  that  for  forecast  periods  of  24  hours 
and  beyond,  the  GP5  and  NP7  25/25  scores  quickly  converge,  owing  to  the  more 
rapid  drop-off  with  time  of  the  GP5  curve  versus  the  NP7  curve.  Hence,  for 
forecast  periods  beyond  approximately  24-30  hours,  the  NP7  forecasts  become 
competitive  with  the  GPS  forecasts,  in  particular,  in  the  BHL  region  of 
Figure  25,  the  NP7  25/25  score  actually  surpasses  that  of  the  GP5  forecasts 
for  forecast  lengths  of  24-  to  48-hours.  The  superiority  of  NP7  forecasts 
over  GP5  forecasts  in  Figure  25  is  substantial  for  forecast  lengths  of  30-48 
hours,  where  on  the  average  we  observe  a  doubling  of  the  spread  between  model 
and  persistence  forecast  curves.  Equivalently,  we  may  conclude  that  the  skill 
score  of  RP7  forecasts  is  on  the  order  of  twice  that  of  GP5  forecasts  beyond 
30  hours  in  Figure  25.  The  NP7  forecasts  are  less  competitive  in  the  FHL 
region  in  Figure  28,  in  which  the  NP7  25/25  score  never  exceeds  that  of  the 
GPS  forecasts. 

Figures  23  through  28  provide  an  excellent  example  of  the  importance  of 
satellite  and  conventional  cloud  observations  to  short-range  cloud 
forecasting.  Despite  the  use  of  an  advanced  moist  prediction  model,  the  skill 
of  the  short-range  cloud  forecasts  (0-24  hours)  depends  heavily  on 
establishing  a  close  link  between  an  initial  cloud  analysis  and  the 
corresponding  forecast  model  initial  moisture  analysis.  After  24  hours 
however,  we  find  in  Figures  23-28  that  the  apparently  superior  dynamics  of  the 
7LHFM  model  largely  overcome  the  disadvantage  of  the  inferior  7LHFM  initial 
moisture  analysis  (inferior  in  a  specific  sense  only,  that  is,  in  its 
reflection  of  the  initial  cloud  cover  as  depicted  by  the  compacted  3DNEPH 
cloud  analysis) . 
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Figure  23. '25/25  score  as  a  function  of  forecast  length  for  the  AFGWC  production  5 LAYER  (GP5) ,  the 
production  7LHFM  (NP7) ,  and  persistence  in  Case  D  (Table  1)  for  the  backhalf  (BH)  area, 
14-day  set. 
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Figure  28.  AS  in  Figure  26  but  for  the  fronthalf  limited  (FHL)  area. 


The  overall  drop-off  in  tie*  of  tha  HP  7  25/25  score  curve  is  surprisingly 
snail  over  the  49-hour  forecast  length  of  Figures  23-28.  One  eight  suspect 
froe  this  snail  downward  trend  that  the  HP 7  curves  in  Figures  23-28  reflect 
little  nore  than  the  skill  of  a  randon  forecast.  This  is  not  the  case* 
however,  as  a  purely  randon  forecast,  derived  from  a  flat  frequency 
distribution,  only  yields  a  25/25  score  of  about  35  percent. 


For  conpleteness,  we  provide  in  Table  6  and  7  the  Case  D  comparison 
results  for  the  KMSE,  STDE,  linear  correlation,  and  bias  statistics.  Aside 
fron  the  bias,  the  trends  and  conparisons  between  the  statistics  in  Table  6 
and  7  are  closely  analogous  to  those  shown  for  the  25/25  score  in  Figures 
23-28  and  will  not  be  discussed  further  here.  The  bias  results  deserve 
further  connent  for  the  BHL  and  FHL  regions  in  Table  7.  (We  recall  that  we 
have  eliminated  in  these  limited  regions  the  subtropical  areas  in  which  the 
7LHFM  moisture  fields  suffer  fron  an  imposed  dry  bias.)  Surprisingly,  the  NP7 
forecasts  in  the  BHL  region  show  a  positive  bias  (too  much  cloud)  while  those 
forecasts  in  the  FHL  region  show  a  negative  bias  (too  little  cloud) .  one 
night  have  expected  the  opposite  result  based  on  the  fact  that  the  NHC  0-hour 
FHL  area  moisture  analysis  incorporates  satellite  and  conventional  cloud 
observations  as  an  additional  data  source. 


We  shall  consider  the  bias  characteristics  in  the  BHL  and  FHL  regions  in 
Case  D  further  by  examining  the  frequency  of  occurrence  curves  in  Figures 
29-32.  Figure  29  shows  wide  disagreement,  especially  in  overall  shape, 
between  the  0-hour  initial  frequency  distribution  curves  of  the  NP7  and  GP5 
forecasts  in  the  FHL  area,  in  this  context,  the  0-hour  GP5  curve  is 
considered  truth.  Figure  30  for  the  BHL  area  on  the  other  hand  shows  fair 
agreement  at  the  clear  and  overcast  ends  and  in  overall  shape  between  the 
0-hour  initial  frequency  distribution  curves  of  the  NP7  and  GP5  forecasts. 
Thus,  while  the  BHL  area  shows  a  larger  0-hour  NP7  overall  bias  than  does  the 
FHL  area  in  Table  7,  the  NP7  0-hour  frequency  distribution  more  closely 
reflects  reality  in  the  BHL  area  than  in  the  FHL  area.  This  also  holds  true 
when  one  examines  the  forecast  frequency  distributions,  as  for  example,  in 
Figures  31  and  32.  The  superiority  of  BHL  versus  FHL  NP7  forecast  frequency 
distributions  probably  accounts  for  the  superior  performance,  relative  to  GP5, 
of  the  NP7  forecasts  in  the  BHL  versus  the  FHL  area. 
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Table  6.  Additional  statistical  information  for  Case  D,  the  backhalf  and  fronthalf  areas, 
contrasting  persistence  (PERS) ,  AFGVJC  production  (GPS) ,  and  NMC  production  7LHFM  (NP7)  cloud 
forecast  cases. 


CASE  D  (BACKHALF  LIMITED  AREA) 


FCST 

RMSE 

STDE 

BIAS 

LINEAR 

CORRELATION 

LENGTH 

PERS 

GP5 

NP7 

PERS 

GP5 

NP7 

PERS 

GP5 

NP7 

PERS 

GP5 

NP7 

6 

24.0 

21.9 

34.8 

24.8 

21.9 

34.5 

1.6 

1.7 

-4.9 

.755 

.794 

.541 

12 

30.1 

26.7 

38.0 

30.1 

26.7 

37.6 

.1 

.0 

-5.6 

.645 

.702 

.468 

24 

32.1 

29.6 

38.8 

32.1 

29.5 

38.4 

-.3 

-1.7 

-5.4 

.603 

.651 

.461 

36 

37.5 

33.2 

39.4 

37.5 

33.1 

38.7 

.0 

-2.4 

-7.3 

.450 

.537 

.443 

48 

37.8 

35.4 

40.3 

37.8 

35.3 

39.8 

.1 

-3.2 

-6.0 

.452 

.503 

.421 

CASE 

D  (FRONTHALF 

LIMITED  AREA) 

FCST 

RMSE 

STDE 

BIAS 

LINEAR 

CORRELATION 

LENGTH 

PERS 

GP5 

NP7 

PERS 

GP5 

NP7 

PERS 

GP5 

NP7 

PERS 

GP5 

NP7 

6 

27.5 

26.1 

45.7 

27.4 

26.0 

42.9 

2.4 

1.7 

-15.9 

.684 

.699 

.252 

12 

32.6 

29.4 

44.0 

32.5 

29.4 

41.3 

2.2 

1.0 

-15.0 

.539 

.603 

.292 

24 

35.2 

32.4 

47.1 

35.2 

32.4 

42.9 

-1.0 

-.8 

-19.5 

.456 

.539 

.249 

36 

38.9 

35.0 

45.3 

38.8 

34.9 

42.9 

2.2 

1.0 

-14.7 

.343 

.455 

.267 

48 

39.8 

38.0 

48.2 

39.8 

38.0 

44.5 

.0 

-.7 

-18.6 

.303 

.374 

.200 

Table  7.  As  in  Table  6  but  for  the  backhalf  and  fronthalf  limited  areas. 


CASE  D  (BACKHALF  LIMITED  AREA) 
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GP5 

NP7 

6 

23.8 

21.3 

28.3 
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21.2 

27.9 

-1.3 

.8 

4.9 

.768 

.802 

.683 

12 

30.3 

26.3 

29.S 

30.3 

26.3 

28.8 

.0 

.7 

6.4 

.620 

.692 

.664 

24 

34.1 

30.4 

30.7 

34.1 

30.4 

30.0 

-.2 

-1.1 

6.5 

.533 

.618 

.654 

36 

38.3 

33.0 

31.9 

38.3 

33.0 

31.8 

-.5 

-2.2 

2.8 

.393 

.524 

.609 

48 

39.2 

36.2 

34.3 

39.2 

36.1 

34.1 

.1 

-3.1 

3.8 

.388 

.471 

.564 
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Figure  29.  Total  cloud  frequency  distribution  for  the  AFGWC  production  5LAYER  (GP5)  and  the  NMC  production 
7LHFM  (NP7)  0-hour  analyses  in  Case  D  (Table  1)  for  the  fronthalf  limited  (FHL)  area,  14 -day  se' 


Figure  30.  As  in  Figure  29  but  for  the  backhalf  limited  (BHL)  area 


VERIFICATION 


Figure  31.  As  in  Figure  29  but  for  the  48-hour  forecasts  and  verifying  analysis 


VERIFICATION 


Figure  32.  As  in  Figure  29  but  for  48-hour  forecasts  and  verifying  analysis  in  the  backhalf  limited 
(BHL)  area. 


It  is  instructive  in  Case  0  to  compare  actual  displays  of  6P5  and  NP7 
total  cloud  analysis  and  forecasts.  Figures  33  and  34  provide  shaded  displays 
of  6P5  and  NP7  initial  (0-hr)  total  cloud  analyses  derived  from  the  Case  D 
data  set  for  the  10  Sep  1979  test  day.  In  these  figures,  cloud-free  regions 
are  represented  by  white  or  blank  areas  and  overcast  regions  are  represented 
by  heavily  darkened  areas.  Increasing  gradations  of  shading,  then,  denote 
larger  cloud  amounts.  The  artificially  dry  subtropical  belt  in  the  7LHFM 
initial  moisture  fields  is  readily  apparent  in  Figure  34.  Even  outstide  the 
subtropics,  there  are  obvious  differences  in  the  GPS  and  NP7  analyses  in 
Figure  33  and  34.  In  general,  the  NP7  cloud  analysis  is  much  smoother  in 
appearance  and  it  exhibits  relatively  gradual  spatial  transitions  between 
clear  and  overcast  areas.  The  GP5  cloud  analysis,  in  contrast,  is  much  less 
smooth  and  exhibits  more  spatial  variability,  sharper  gradients  between  clear 
and  overcast  areas,  and  generally  smaller,  less  organized  overcast  regimes. 

The  smooth,  continuous  nature  of  the  initial  NP7  analysis  in  Figure  34  appears 
to  be  more  appropriate  as  a  representation  of  the  continuous  synoptic  scale 
relative  humidity  distribution  rather  than  as  a  representation  of  the  highly 
discontinuous,  synoptic  and  mesoscale  cloud  patterns  routinely  obtained  in  GP5 
cloud  analyses  derived  from  the  3DNEPH. 

The  characteristics  of  the  analysis  displays  in  Figures  33  and  34  are 
largely  persisted  in  the  corresponding  24-hour  GP5  and  NP7  forecast  displays 
in  Figures  35  and  36.  For  completeness,  the  verifying  GP5  analysis  display  is 
also  provided  in  Figure  37.  We  see  in  Figure  36  that  the  dynamics  of  the 
7LHFM  has  led  to  sharper  cloud  amount  gradients,  which  are  associated  with  an 
increase  in  strictly  clear  and  strictly  overcast  areas*  These  sharper 
gradients,  coupled  with  the  more  rapid  and  skillful  movements  of  the  major 
synoptic  systems  in  Figure  36  versus  Figure  35,  contribute  to  the  improvement 
in  the  NP7  versus  GPS  forecast  skill  that  was  apparent  at  24  hours  and  beyond 
in  Figures  23-28. 

3.2.3  Case  E-F  Results 

Owing  to  the  substantially  worse  overall  performance  of  the  NP7  versus  GP5 
forecasts  in  Case  D  (Figures  23-28  and  Tables  6  and  7) ,  the  question  of  the 
impact  of  delayed  7LHFM  databases  in  Cases  E-F  is  largely  immaterial. 

Clearly,  a  delay  in  the  availability  of  the  7LBFM  databases  will  further 
degrade  the  already  poor  KP7  performance  documented  in  Case  D.  Therefore,  the 
Casa  I  and  F  comparisons  in  Table  1  will  not  be  systematically  pursued  here. 
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figure  33.  Shaded  total  cloud  display  of  the  AFGWC  production  5 LAYER  (GP5) 
O-hour  analysis  from  the  03Z  GP5  database  on  10  September  1979. 
■lank  areas  are  cloud-free  and  heavily  darkened  areas  are  over¬ 
cast  .  All  half-mesh  (lOOnm)  grid  points  are  represented. 
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figur*  H.  8hatd*d  total  cloud  display  of  the  NMC  production  7LHFM  (KP7)  3-hour 
forecast  from  the  00Z  NP7  database  on  10  September  1979.  The  fore- 
OBBt  valid  time  agrees  with  that  of  the  GP5  analysis  in  Figure  33. 
Otherwise  as  in  Figure  33. 
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figure  35.  As  in  Figure  33  but  for  the  24-hour  forecast. 


.  »B«fb.ft 

i « 

,‘.cre«i 
>i  XMl 
•  SJfi* 

.  4  “-Xt!!; 

tff.ee  idt' 

•i.ireetr*, 

»♦  i 

It  ‘HlH/r  •  ,, 


/  -».•••• i  i » »--  V 

/  x 

/  »<•••  :ttct  X 

f  !  CtiiUilklC..  • « » -  *  ,-i-X 

-»(-££ktH£i*ei.c,.  .>  >  1 1 - .-iin-X 

,  i  *:utMec;uM:  : . '  1 1 1 i i  »*»**- 1 - 1 1  i--X 

. ,  —  ii4.tcccttre<ta.cr£C££ccr<>x«««Mi()ji-'iii--‘X 
•l-I«XA',  *Cktif.  f  Ctf.  it  itlTll  If  T.  i  1  ff  ♦  1  1  n  t  II  n-nX 
i*».4  tt n.cttBectre6tc6zte::?siHXii****i} in >,-n nX 
•  t  ^ttictmaufrMirtftriitic)  i  i-X 

-.  >4  «.fc/<At-c*.*f  erPit 

,•  ,.,-n  *.  '(/.'muoi  .  4  , 


c« .  •, rtetc  t .  , 

i,  .  ,  >-c  Ltr.tff 

,  «cere«t'*4  trcxccettf/  , 

>  -ftAACESrct*-  .•**/,  • 

i  -ttsettezf :**AXAt 

-  term*  i ,  i  •••*.••,  i  - 1 •. ■*«»»»♦♦  in  — 

fittrt  ttf  '-.i  »*■»«• 

i .  crtcit  4  cut  w  >  <•**_*•- 

.p*ccct*r?r  i  .ix,  AtctAxi- 

,1,  ft.kt.Af.leK*  It 

i  .  >•••.'  x  trrrrnrr  •  .  -  -<  *.  » *>e*  -  r 


»*•*  • 
.-III, 

t  —  *1 


m  ro 1 1 1 1  i  i  >  > .  .  >  Ltutrrtrtt  \ ,  t  .  .  » #  m»* ,  .  ,• 

•  . .  i.i'.  MmufMiiwMt-  i,  i.j..  ••/■*•  i 

„  _  .1  '  1  -  «/.»•*.•  *  *f  vi'tjri-* - I. 

’  *  t*-»i£ef«t£;?e?4«££»  »i  «c»ta>-.  • 

.•*rirrentlt/*  i  .-1  m.  * xcter iiteeiric-*  iinutijnt.  ai-  -,  • 

-vctat*» c<. . .  i-,  , —  m « . ctfiftirtizi*  cetrciot*/ .  -»r»- 

•  i  '.** ki'teen •!«*(!  —  1 1 a  •  n . « ^rr-’M/cut  -a* -£izc«e«ccr .«  i  — ,  ,-i  1 1- 

-ftr/ 1  *k,t:u  ♦  i  - 1  .mil.  ■  4  t (testers:  *i  —  -i«*n, 

»♦.  i  t.-i*. a»i »  i-i  it  xt**tiZtrttttrrc*.-  ^*tt»eteereet*i --  ,,  -n*i- 

♦  1 1 <  --A=fcffe  c£V£c«-.<;<'..caf?rrr££B.‘ ;-, ,  lit  inn 

-  ,  i  .  ctctrtt  fte  ,n-  -i — 

-  -a*  -  tteeecfctf ♦  t:»ccc£:. »f ;?t- mi coi«»r?eecc.’» )-,  ui.  , 

,  -  ••niacimmti>A«i-l,  I 

i  ,-it..ic*fSfe££*«8f««e*. «£*itc-/t££rc-*. /ft  'ectcsJeeeaeiCki)-,  x  - 

,-,,1.1  ,,T4«,-4i.iU(l(ia(M(2K;  ^ieC(et;»t'(  -  fttakttCfc' ‘  Ktcctlt*  1  >•, 

--I-, ccetitz*z  tuerarert  *  x.  ttc  e , .  .  c.*A*.er*ei!£t6e-  a.  ♦  *  .ccftc-  i- , . , , ,  -i  i  «,t«i 

-  t  !--♦»  4  •..-.t£££Ckt<  i>  */*/.!•  «t£f«f.  ft  f  eCS  *£££(£  ££SkClkC''*XAk££C‘  XJ - 11«U'X«- 

1 1 » --*  r .  .  •  i :  .ci/£  *ft££  rtr  tee  ten  tj.utoitii  *♦:»->  in  nxxi, 

,  u  ii  •itkk«£*f*si4  «i - if4««e*.  a«.  -  . :  i£r*£?ff?rcra££8etBtraxtiCHr/4.*4  x*:i  i  —  »i*»- 

'  i * 1 1 •  - kAci.sf 2»*. .  >i - m , i . f >kt. > « . . . CiimtmtiMcuct < .  •  •  c»  »cc- -cteifti-,,-  in, 

■  .•.♦i.  «£rerrc..i>*i  — ,,  »ft.'f.,-ft*Aj-t6t£«s?£f?.*effl»*6ktcr4»i.txccMA«seAfti  ,  hi, 

ft/»i£J£ti*ft.*4.ft*f  *C*f££.’f  Jf£f**lKkki»*  *,/  -Hit  fi-kkftftl-  - 1 1 

.  fzx.ncrtttttx:  •■■6*.»  :»t  ecr£Tyf££f£6«£8£«4Ct>i  I.a,>.i/A'»»;uxi  — 

1-tCS,  iCitUv.  '.£»€**»«•  I  .  -ftki  •f-ec#/.  :£££.*.*££?e*^*a«4ne«^l)ftftft*  ift  ft*  kX  *«*!».» --- 

j  -Bcc«*e»vtk-.ft£ktt£££  ♦!.  ,  i*:tft£«s- .  :££cf££ice*ftA«;«k  icetji-iiix^ik*  k.*««*e*ft»-- 

,♦  kiccttcc  :;utrr(ffc  «, -  , i*ft:£»ia«cc<e£»r.esk/ •netmetf  —  >ifti.:ft<*k»r«Mfcfti-, 

,  1 1*.- *«c£kcc;.*£cc*c*-,-u-  » tRC’i  — >»*n  i.citcce.  «i- 


•uisumhimt..-  m«.  *i  __ 

• i , , i i i , 

i , ,  i  n  •  *.■  ne  xtHMx.  • 

.(•ummummi-'-ii  ft*4tc«t» ■  e«.vrs* 

.fkCetiititU£Ktiftii-ivi«x**'(ai::i?{!ri 
* .  - kkkseitMteikk* ««.i--;  «*  v  .*  t  ■  •■■.  , 

■Ak**Akft.Bk'££(i*;xftftn *«xi>ft;*4.xft..'cs;:;c4'- 

»•/< ♦  ll  n*  .i<£iftft*«>  * *•  «•'»  i  ztirttz:  i 


-,-trtttirrtir 
n-c«« ITtTttt 
ii  .*.6 Aiiftit 
,-i  .  t-kcceaie 

4*1  »  ftftkkkSC 

,-l 1  ftft.  •  A»* lllft 
.II"  »«/*♦!  I  n 


,ic«-i,-iftft».-M*«*exxftii, 
ute»-,--i  it*,  “ckc*  imi. 


•  »*.  i  in  i— » 

.mil . i— 

-m - *, 

*  ’•••**  Mil 

»»•••»*♦» 

ft 

I t *••»» • 

»••*»*• 
f  t • • • 

•  ••••mi 

. *  t  f  • 

»  Ml  •**•• 
*••••#♦-•# 
rMIM-, 

V  ,--IHI---,, 


i»«ftx  *•',  i  --I : ..  ecarfes.'i , 


tift%M£ift»ftft»***  «*’»  i 

-»i#e*£'*x  i»xcct«i’-i- 
;  -  -  i  i*  ■  ♦  ♦  ink!  zii'  i , 
,iil— »l*S?*f*Bi, 


-  irei 

i  sit  ;■ 

,<tlii 
,  ftt.Skkl 
,  CGC‘  k  I 


,-i  !»»:< 

lUUKCft 


c*t»- kca.T^rst  -  irei  , - i«/>!«imiiii 

-ikA*:  s£??rf r  iset;  -i--,, -i>„«cA>,-ii, 

■l-S.-UIJM*,  •  •  a  tit  I  -1-,,  ,  1*111)  0,-1- 

♦  ,.X». .£«?!?£/-  ,«i.fi*n  -I--,,- l*ft2ZX*-  I 

-i :».  ec£ffe:/i,  /tcc-n  , - ,-n *xxx*-  n -- 

,-iftktcscsc  ,*n,  ixkccem  - )*ftx*i-  -i 

.-a  s*r  >  *ma*t»c»x ,-i  i— -i i i«n,  -ml*, 
,-ift.er»;;  .•  ui*eiMii*ii*.*iftn— -in'-  - 1 1 1 1 -- 

..ciilfKtr - ,-i*iXl----i-,  •  -nm- 

,-:.;(uu((rmiiitim,  --i  i  n  - 


'  I  ,  - •  c£S*£,T?FC t  kBII£KKE£“  1  • 

i  *;.  cczci'  -5.cx.*irS«I-4.^xxxxt«kft- 

i: Aixezct ,  ,  r  tar srstn  •  1 1--1  u»"*i 

liftft“*«Cft  ,  ItKPTtTitZ* - l.*ftftl 

,/;/*£££%,  I,  ncsrtcc*.  i(,  ,,-*£/ 1 

lltiCfji  t  I-Bltt*  i  I  ,, 

-»•  .!»•♦».  #•<  ’t»e  £*•■■•,  ,, 

,nnii,  - .  •  1 1  ,  ,, 

,  i 

1.4  .«  I,  •  »  I  * 

■•kt-ft-, 


.-n*:--ft — , 

,  - 1  •*  i ----- , 
» - 1  ♦  i  -  -  - - — 
»--*!-— •», 
... I .... t 


r..»  Vf 

-lift  ill  ,  ,  ,  ,  - 

-  •  i  l  ♦*  xi ,  •  ,----iii. 

-I***!*.  |l  1*  I,,  »-  I  II  I  1«*4  • 


•«,»  »»-**  t  i 

i,,  -,,, 

, ,  ■ -  -  ft t SB- .  .  , 

, ,  ,,,iin  iA«rftcc»i.ft  >  i , 
i .  1 1 1 ,  ...ft.ftfifrffiu** 

*  I*****!!*  itit.'iiritt.  i 

. .  t  t  ii ««ft..scBirrcMtc.  i 


-iiii- 
—  M  — 

,<k#kft*  m 

»*-•#  ft 
III./ 
*•  / 


i  •.x»xkx.«i«i4:i*ftXA4  xx.-’ccirri£t.  AikiiUki 

i  •»*|ft|UI*ftlftft*’*.l •  kA*  A/  AI  fckkktl*  1 111**11-, 

-x • : 1 1 nx*i fti.k«.ksc*ce.  ,Ap.-k*.>*i-,  in, 

i  a  ♦ ,  —  ,iiti,’ftteici'ix.iMi»ftii*  , 

•  ftftl  -ftX.'kk  kkC  -Al--ll»|»- 


,-ft.  x/.u.lKCCItmKC.l 

,-»•  :e*  cciccccekct'ftx i, 

-i»  -•  rtl  .  ftekllCCCf  B-'AftftftXXhl  I 

.  ceck*  nekea««»kC“*i-,-i  1 1- , 

itt;  £.£.'Ai;HtAift|—  -,,  ,,, 


ll>ft«.’A*!t*ftl  — , 

i x  n 1 xx£* i  i  — 

, >  1 1 1 1* *ii i,— - 
,-lil*linii, 
, - 1 i 


SIMM; 


.--III* 


mm;  ;  • 
■  * .  - 


fifitr*  36.  A*  in  Figure  34  but  for  the  2 7 -hour  forecast.  The  forecast 
valid  tiae  agrees  with  that  of  the  GPS  forecast  in  Figure  35. 
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Figure  37.  As  in  Figure  33  but  for  the  GP5  O-hour  analysis  from  the  03Z  GPS 
database  on  11  Sep  1979.  This  analysis  represents  the  verifying 
field  for  the  forecasts  in  Figures  35  and  36. 
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4  CONCLUSIONS  AND  RECOMMENDATIONS 


jj 


4.1  Conclusion! 


His  essence  of  the  conclusions  itemized  below  is  embodied  in  Figure  38,  which 
cosiperes  tbs  forecast  accuracy  of  persistence,  the  current  production  SLAYER 
driven  by  6LDPB  winds  <GP5) ,  the  test  5 LAYER  driven  by  7LHFM  winds  (6T5) ,  and 
the  moist  7LHFM-derived  cloud  forecasts  (NP7) .  We  choose  to  depict  the 
extra-tropical  backhalf  area  results  in  this  final  composite  figure  because 
the  GT5  and  NP7  test  forecasts  provided  their  best  results  in  this  region. 

(a)  During  the  test  period,  the  horizontal  wind  velocity  forecasts  from 
the  7LHVM  model  show  an  RMSVE  reduction  of  approximately  14  percent  when 
compared  with  the  corresponding  6LDPB  wind  forecasts. 

(b)  The  7LHFM  horizontal  wind  velocity  forecasts  of  lengths  up  to  TT  +  12 
hours  exhibit  essentially  the  same  RMSVE  accuracy  as  the  corresponding  6LDPB 
forecasts  of  length  TT  hours  during  the  test  period. 

(c)  For  forecast  periods  of  12  hours  or  greater,  5 LAYER  forecasts  driven 
by  7LHFM  winds  show  an  absolute  improvement  in  the  25/25  score  of  about  1.5 
percent  in  the  fronthalf  area  and  about  3  percent  in  the  backhalf  area, 
relative  to  production  5 LAYER  forecasts  driven  by  6LDPE  winds. 

(d)  For  forecast  periods  of  24  hours  or  greater,  5 LAYER  forecasts  driven 
by  7UFM  winds  show  a  25/25  skill  score  (computed  relative  to  persistence) 
that  is  twice  the  25/25  skill  score  of  the  production  5 LAYER  in  the  backhalf 
area.  The  corresponding  skill  score  improvement  in  the  fronthalf  area  was 
generally  less. 

(e)  For  forecast  periods  of  24  hours  or  greater,  the  5 LAYER  forecasts 
driven  by  7LHPM  winds  show  an  RHSE  reduction  of  about  1.5  percent  relative  to 
the  production  5 LAYER  forecasts.  Thus,  the  14  percent  reduction  in  7LHFM 
versus  6LDPB  RMSVE  values  cited  in  (a)  above  generally  translates  into  an 
order  of  magnitude  smaller  percent  reduction  in  the  RMSE  values  of  the 
subsequent  SLAYER  cloud  forecasts. 

(f)  The  12-hour  forecast  extension  exhibited  in  7LRFM  versus  6LDPE  wind 
forecasts  as  cited  in  (b)  above  generally  translates  into  an  equivalent 
12-hour  forecast  extension  for  SLAYER  driven  by  7LHFM  winds  versus  SLAYER 
driven  by  6L0PB  winds. 

(g)  Owing  to  differences  in  the  extent  and  method  by  which  NHC  and  AFGMC 
use  satellite  and  conventional  cloud  observations  in  deriving  their  respective 
initial  moisture  field  analyses,  there  exists  a  large  disparity  between  the 
initial  cloud  analyses  obtained  from  the  7LHFM  and  production  SLAYER  initial 
moisture  fields.  The  SLAYER  initial  cloud  analyses  agree  more  closely  with 
satellite-observed  cloud  oover . 

(h)  As  a  consequence  of  the  initial  cloud  analysis  disparity  cited  in  (g) 
above,  the  0-24  hour  cloud  forecasts  derived  directly  from  the  7LHFM  moisture 
forecasts  show  substantially  less  skill  than  the  0-24  hour  production  5 LAYER 
cloud  foreoasts,  when  both  are  verified  against  a  compacted  3DKSPH  analysis. 
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Figure  38.  25/25  score  as  a  function  for  forecast  lengths  for  the  AFGWc 

production  5LAYER  (GP5) ,  the  AFGWC  test  SLAYER  (GT5) ,  the  NMC 
production  7LHFM  (NP7) ,  and  persistence  for  Cases  A  and  D 
(Table  1)  for  the  backhalf  limited  (BHL)  area,  14-day  set. 


(i)  Owing  to  apparently  superior  dynamics  in  the  7LHFM  advanced 
prediction  model,  the  disadvantage  of  having  a  7LHFM  initial  moisture  analysis 
that  poorly  reflects  initial  cloud  cover  is  largely  overcome  for  forecast 
periods  beyond  24  hours.  In  the  24-  to  48-hour  forecast  range,  7LHFM-derived 
cloud  forecasts  are  competitive  with,  and  in  some  cases  superior  to,  the 
corresponding  production  SLAYER  forecasts.  In  particular,  the  30-  to  48-hour 
7HfM-derived  cloud  forecasts  exhibit  a  25/25  skill  score  that  is  about  twice 
that  of  the  production  5LAYER  forecasts  in  extratropical  regions  of  the 
backhalf  area. 

4.2  Recommendation  for  Further  Stud 

It  is  clear  in  Pigure  38  that  the  best  forecast  accuracy  over  the  entire  range 
of  0-48  hours  is  achieved  by  the  5LAYER  model  driven  by  7LHFM  forecast  winds. 
However,  the  slow  drop-off  of  the  HP7  skill  curve  in  Figure  38  suggests  that 
the  greatest  ultimate  improvement  in  cloud  forecast  accuracy  might  be  achieved 
by  incorporating  3DNBPH  cloud  analyses  into  the  derivation  of  the  7LHFM 
initial  ax>isture  fields.  If  we  can  thereby  eliminate  much  of  the  initial 
disparity  between  the  GP5  and  NP7  curves  in  Figure  38,  a  significant 
improvement  in  cloud  forecast  accuracy  may  be  realised.  To  pursue  this 
possibility,  tie  recommend  that  a  follow-on  models  comparison  test  be  performed 
in  which  1MC  is  provided  with  APGHC  3DNBPH  cloud  analysis  databases  for 
incorporation  into  the  initial  moisture  field  of  both  the  7LHFM  model  and 
NMC's  newly  operational  Global  Spectral  Model. 
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5.  APPENDIX  -  GLOSSARY 


This  glossary  is  an  alphabetical  listing  of  tha  abbreviations  and  acronyms 
used  in  this  Technical  Note. 

AFGWC  -  Air  Force  Global  weather  Central 

AWS  -  Air  Weather  Service 

H  -  Backhalf  area  of  the  5LAYER  forecast  grid,  primarily  Europe  and  Asia 

B8L  -  Backhalf  area,  but  limited  to  points  north  of  30°N 

CMC  -  Canadian  Meteorological  Center 

CPS  -  Condensation  Pressure  Spread 

DMSP  -  Defense  Meteorological  Satellite  Program 

ECMWF  -  European  Center  for  Medium-range  Weather  Forecasting 

FH  -  Fronthalf  area  of  the  SLAYER  forecast  grid,  primarily  North  America 

FHL  -  Fronthalf  area,  but  limited  to  points  north  of  30°N 

reoc  -  FLeet  Numerical  Oceanographic  Center  of  US  Navy  (formerly  FNWC) 

GP5  -  AFGWC  Production  5LAYER 

GT5  -  AFGWC  Test  SLAYER 

HUFANL  -  Upper-air  spectral  (Hough  function)  analysis  model 

LCL  -  Lifting  Condensation  Level 

LFM  II  -  Limited-area  Fine  Mesh  model,  version  2 

NESS  -  National  Environmental  Satellite  Service 

MNC  -  National  Meteorological  Center  of  US  Dept  of  Cosmerce 

NCAA  -  National  Oceanic  and  Atmospheric  Administration 

NP7  -  NMC  Production  7LHFM 

PE  -  Primitive  Equation 

QPF  -  Quantitative  Precipitation  Forecast 

RAOB  -  Radiosonde  Observation 


Tift 


VS 


Relative  Humidity 
Root  Mean  Square  Error 


RH 
RMSB 

RMSVE  -  Root  Mean  Square  Vector  Error 

SAB  -  Scientific  Advisory  Board 

STDE  -  Standard  Deviation  of  the  Error 

TN  -  Technical  Note 

3DNEPH  -  Three-dimensional  Nephanalysis  cloud  model  at  ATCWC 

SLAYER  -  Five  Layer  hemispheric  cloud  forecast  model  at  AFGMC 

6LDPE  -  Six  Layer  Dry  Primitive  Equation  model  at  AF6HC 

6LVL  -  Six  Level  Quasi-qeostrophic  model  (in  use  at  AFGWC  prior  to  1975) 

7LHPM  -  Seven  Layer  Hemispheric  Fine  Mesh  model  at  NMC 
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